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This  report  documents  the  test  methodology  and  the  results  and  analysis  of  specific  tests 
for  a  developing  U.S.  Navy  Correlator  Tracker.  A  correlator  tracker  takes  data  from  diverse 
sources  in  order  to  determine  a  coherent  picture  of  the  outside  world.  In  the  Navy  context,  the 
correlator  tracker  provides  locational  and  operational  information  of  ships,  submarines,  aircraft 
and  land-based  forces,  both  friendly,  neutral,  commercial  and  of  upmost  imponant  non-friendly 
targets  or  threats.  The  algorithm  in  question  operates  within  a  system  known  as  the  OSIS 
Baseline  Upgrade  (OBU)  where  OSIS  stands  for  Ocean  Surveillance  Intelligence  System.  Due 
to  the  high  volume  of  data,  upwards  of  5,000  repons  an  hour  with  up  to  20,000  extant  tracks,  a 
large  amount  of  data  fusion  is  required  to  be  done  automatically  with  operator  intervention  to 
resolve  ambiguities  and  computer  error.  Since  it  was  determined  that  the  algorithm,  otherwise 
known  as  the  Automatic  Correlator  Tracker  (ACT)  was  intractable  from  the  system  in  which  it 
operates,  test  data  had  to  be  transported  and  run  on  the  system  at  its  developmental  facility. 

This  arrangment  put  time  and  data  constraints  on  the  analysis  and  therefore  a  tightly  bound  set  of 
sensitivity  tests  had  to  be  created  specifically  for  the  application. 

Sensitivity  testing  is  defined  as  the  determination  of  performance  at  the  correlator 
tracker's  most  basic  level.  These  tests  then  test  how  the  data  fusion  is  done  when  presented  with 
fundamental  evasive  and  basic  maneuvers  of  targets.  This  included  parallel  tracks,  crossing 
tracks  and  turning  tracks.  Many  of  these  tests  also  provide  a  method  to  assess  the  robusmess  of 
the  algorithm  itself. 


SENSITIVITY  TESTBVG  ON  A  lilEATER-BASED  AUTOMATIC 
DATA  FUSION  ALGORITHM 

INTRODUCTION 

The  problem  addressed  herein  is  the  construcdon  of  a  comprehensive  set  of  sensitivity 
tests  for  a  data  fusion  correlator  tracker  algorithm.  The  data  set  and  rationale  are  presented  and 
the  results  of  a  run  on  an  algoriflim  underdevelopment  are  presented;  Sensitivity  Tests  have 
been  used  in  previous  NRL  evaluations  [1-3]  but  up  until  this  time,  due  to  virtually,  unlimited 
computing  resources  and  algorithm  availability,  a  tightly  bound  set  of  tests  was  never  specified. 
This  work  can  be  viewed  as  a  first  step  in  creating  a  library  of  standard  test  scenarios  to  be  used 
in  evaluation  of  all  similar  algorithms. 

This  report  documents  the  1988  analysis  results  of.the  Naval-Research  Laboratory  (NRL) 
Ocean  Surveillance  Intelligence  System  (OSIS)  Baseline  Upgrade  (OBU)  Automatic  Correlator 
Tracker  (ACT)  evaluation.  The  results  form  a  baseline  of  knowledge  on  how  the  OBU  ACT 
(Patuxant  River- 10/88)  processes  ELINT  and  spatial  information  as  the  algorithm  and  input 
parameters  (distance,  emitter  characteristics)  are  changed.  In  addition,  peculiarities  were  noted 
that  may  have  algorithmic  or  software  ramifications. 

The  ACT  was  tested  for  performance  via  a  series  of  one  to  two  track  "sensitivity" 
scenarios.  In  all,  around  225  of  ^ese  tests  were  run.  The  results  of  the  testing  are  summarized 
and  discussed  in  the  report.  Refer  to  Appendix  A  for  a  complete  listing  of  test  results. 


BACKGROUND 

this  report  is  on  data  runs  made  at  the  OBU  Patuxent  (PAX)  River  Developmental 
Facility  in  October,  1988  and  was  funded  and  coordinated  by  SPAWAR,  PMW-161.  The  data 
was  generated  at  NRL  using  MULTIGEN  (MULTIple  detection  GENerator)  to  simulate  ELINT 
data  repons  [4].  This  data  was  then  transponed  to  PAX  River  and  run  on  the  OBU  System  by 
Fuentez  System  Concepts  (FSC)  personnel.  Due  to  the  dependence  of  the  T/C  on  the  unique 
hardware  configuration  of  OBU,  it  is  too  expensive  to  transfer  a  copy  of  the  T/C  into  NRL's  T/C 
evaluation  laboratory,  and  therefore  data  must  be  run  on-site.  The  output  of  the  OBU  T/C  is 
then  down-loaded  to  a  tape  and  transfeired  back  to  NRL  for  analysis. 

Past  work  by  NRL  on  the  OBU  evaluation  and  a  knowledge  of  the  developer's  needs 
determined  what  testing  should  be  done  and  ultimately  gave  clues  as  to  why  cenain  phenomenon 
occur  in  the  output  data.  This  past  work  included  a  written  analysis  of  the  OBU  documentation 
and  code  entitled  "Mathematical  Analysis  of  the  OBU  Automatic  Tracker/Correlator  (May, 
1987)"  based  on  specifications  written  circa  1986.  While  NRL  concluded  that  the  ELINT 
model  (TERESA)  and  the  position/velocity  models  used  in  OBU  were  sound,  the  way  the  ACT 
was  to  handle  the  incorporation  of  observations  was  questionable.  Specifically,  at  each  stage, 

"OBU  attempts  to  correlate  Internal  Contact  Reports  (ICRs)  based 
on  only  one  kind  of  information  (spatial,  ELINT,  etc.).  Previously 
considered  types  of  information  may  have  been  used  tO;prune  the 
list  of  candidates,  but  among  those  which  survive,  all  relative 
scores  are  ignored.  An  association  which  scores  well  on  many 
Msasures-of  Correlaiion  (MOCs)  should  be  coii’sidered  a  better 
candidate  than  an  association  that  scores  slightly  better  on  one 
MOC  and  only  margihdjy  better  on  the  others.  This  may  lead  to 
geo-graphically  inconsistent  tracks,  where  the  ICR  may  have 
barely  passed  the  Gross  Rarige  Check  and  then. the  TERESA  test 
indicates  the  the  ICR  should  be  correlated  to  a  track  and  a  more 
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detailed  spatial  test  is  never  done." 

Additionally,  the  report  pointed  out  possible  problems  with  the  test  for  a  new  emitter  (via  the 
New  Emitter  Statistic),  out  of  sequence  data  incorporation,  the  track  linking  (LINK)  association 
rules  (matched  only  by  number  of  emitters/track),  the  Gross  Range  Check  (GRC)’s  incorporation 
of  uncertainty  ellipses  and  the  disregard  for  report  uncertainties  in  the  multi-point  track  initiation 
module  (CLUSTER).  Since  that  report  was  wHtten,  several  changes  were  made  to  the  T/C 
which  supposedly  addressed  these  problems. 

In  February-March  of  1988,  the  PAX  River  Developmental  Facility  (DF)  was  available 
for  data  runs  and  a  smdy  was  completed  which  concluded  that  OBU  was  having  trouble 
maintaining  long,  t^sittmg  tracks,  thus  creating  some  geographically  unrealistic  tracks  and  that 
the  LINK  and  CLUSTER  modules  were  responsible  for  creating  a  number  of  "garbage"  tracks. 
These  results  were  reponed  to  SPAWAR  in  March  of  1988.(2] 

Based  on  this  experience  and  knowing  the  T/C  had  undergone  a  significant  change 
between  February  1988  and  October  1988,  NRL  and  SPAWAR  decided  to  rerun  the  February, 
1988  data  set  in  Ae  October  1988  runs.  In  addition,  a  more  detailed  study  of  the  effects  of 
ELINT  and  geographic  separation  led  to  the  creation  of  a  set  of  a  parallel  tracks  tests  with 
repetidons  of  tests  to  account  for  any  random  unknown  errors. 


DESCRIPTION  OF  DATA 

In  total,  three  sets  of  data  consisting  of  roughly  75  subsets  of  sensitivity  tests  and 
roughly  7(X)0  reports  were  run  in  October  1988.  A  sensitivity  test  is  defined  as  one  or  two 
ground-truth  tracks  or  targets  making  at  most  one  maneuver  each.  Each  track  in  these  tests  is 
composed  of  50  Internal  Contact  Repons  (ICRs)  arriving  at  a  nearly  constant  rate  of  one  per 
hour.  The  targets  move  at  constant  speed  (20  knots/hour)  along  rhumb  line  courses.  Each  track 
was  modeled  as  having  only  one  emitter  based  loosely  on  DON/DON  II  radar  characteristics 
with  Pulse  Repetition  Interval  (PRI)  and  Scan  Rate  (SR)  values  randomly  drawn  from  a  normal 
distribution  -  similar  to  the  way  in  which  OBU’s  ELINT  correlator,  TERESA,  models  its 
emitters.  The  reports  come  in  via  the  SOSUS  line  as  Selor  Red  repons  generated  by  a 
CLASSIC  WIZARD  passive  radar.  The  first  two  reports  on  each  track  include  a  unique 
attribute  (NOSIC  ID)  which  "forces"  OBU  to  initiate  that  oack.  This  removes  any  possible 
confounding  problems  due  to  reported  multi-point  track  initiation  (known  as  CLUSTER  in 
OBU)  problems.  The  motivation  for  this  approach  is  that  the  largest  and  most  complex  scenario 
is  composed  of  individual  targets  following  courses  that  are  composed  of  constant  course  and 
speed  legs.  The  scenario's  complexity  will  increase  both  as  the  time  length  of  the  legs  decreases 
and  as  the  density  of  targets  increases.  However  it  is  clear  that  if  a  T/C  is  to  handle  large, 
complex  scenarios  it  must  first  be  able  to  handle  the  simple  elements  of  which  such  a  scenario  is 
made.  Indeed,  in  a  very  large  scenario  such  as  ECAP II  (the  NRL  Mediterranean  Scenario)  it 
seems  likely  that  if  the  time  on  leg  is  sufficiently  large  and  the  density  is  sufficiently  low,  the 
total  performance  will  be  predictable  from  the  performance  characteristic  for  the  individual 

simple  elements.  The  general  characteristics 
of  the  data  sets  are  reviewed  in  Table  1. 

Figure  1  on  the  following  page  summarizes 
the  properties  of  the  sensitivity  tests  used  in 
the  evaluation.  The  simplest  ground  truth 
scenario  consists  of  a  single  target  moving 
along  at  constant  course  and  speed  and 
turning  half-way  through  the  test.  If  a  T/C 
cannot  follow  a  simple  single  course  change 
then  there  is  no  hope  of  it  following  a  large 
number  of  targets  through  a  large  number  of 
course  changes. 

Two  targets  can  interact  in  a  variety  of 


General  Characteristics  of  NRUOBU  -  PAX  Data 

-7000  repons/data  set 
-75  tests/data  set 
1-2  tracks/iesi 
50  reports/track 

Constant  platfonn  speed  of  20  knots/hr 
Emitters  modeled  approx,  on  DON/IX)Nn 
Reported  by  WIZIARD 
Rhumb  line  courses 
PRI  and  SR  values  normal  dist.  draw 


Table  1:  Characteristics  of  input  data. 
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ways.  The  simplest  of  these  is  to  have  the 
targets'  courses  cross  while  each  target  is  in 
the  middle  of  a  constant  course  and  speed 
leg.  This  test  is  called  the  Crossing  Test 
The  interaction  can  be  complicated  if  one  or 
both  targets  also  maneuver  at  the  time  of 
closest  approach.  One  target  maneuvering 
is  covert  in  Straight-Turn  Test.  Both 
targets  maneuvering  at  closest  approach  is 
known  as  the  Tum-Tum  Test.  Hnally,  the 
Parallel  Tracks  Test  (Figure  1.1  only)  is 
actually  a  variation  on  Tum-Tum  testing  in 
which  the  targets  courses  do  not  cross  at  the 
point  of  intersection  but  continue  in  a 
parallel  course.  All  of  these  tests  are 
located  in  the  Sensitivity  Test  Data  Set 
(STDS)  except  for  the  Parallel  Tracks  test 
described  in  Figure  1.2  in  Figure  1.  The 
Parallel  Tracks  Data  Set  (PTDS)  consists 
only  of  tests  with  the  characteristics 
described  in  Figure  1.2.  Instead  of  two 
targets  approaching  each  other,  and  then 
running  parallel,  the  tracks  in  PTDS  mn 
parallel  throughout  the  test  with  the  first 
fifteen  reports  given  NOSIC  IDs.  This 
approach  allows  for  proper  initiation  of  a 
track  at  any  geographic  separation  from  its 
sister  track  without  the  motion  model 
problems  that  are  encountered  with  tests 
like  Figure  1.1. 


Sensor  Report  Characteristics 

FLINT  separation  is  referred  to  in 
terms  of  standard  deviations.  If  the  first 
target  has  FLINT  parameters  drawn  from  a 
normal  distribution  with  mean,  p,  and 

standard  deviation,  cr,  and  the  FLINT 
separation  is  N  then  the  second  target  has 
FLINT  parameters  drawn  from  a  normal 

distribution  with  mean  p  +  No  and  standard 

deviation  o.  At  0  standard  deviations 
separation,  the  two  sets  of  FLINT  attributes 
should  be  statistically  indistinguishable.  At 
1  standard  deviation  separation, 
approximately  30%  of  the  FLINT  attributes 
in  the  reports  are  closer  to  the  mean  of  the 
other  target’s  FLINT  attribute.  At  4 
standard  deviations  the  two  sets  of  FLINT 
attributes  are  almost  completely  separated. 

In  Figure  1,  values  for  ^e  Afferent 
points  of  testing  for  FLINT  are  given  for 
each  test  type.  The  Crossing  Tracks  Test 
and  the  Parallel  Tracks  Test  had  tests  at  Descrip, ion  <^ScnsUi.Uy  Tests 
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Important  Parameter  Settings  for  October,  1 988  PAXIOBU  Runs 

PS-1 

PS-2 

New  Emitter  Statistic  Threshold 

0:15 

0.14 

Elint  Margin  Threshold 

0.14 

0.50 

New  Track  Threshold 

0.95 

0.70 

Spatial  Correlation  On? 

NO 

YES 

Spatial  Margin  Threshold 

N.A. 

Table  2:  Parameter  Settings 


ELINT.SepMationof  {0, 1^3,4}  while  the 
Turns  Tests  had  ELINT  Separations  of  {0,1,2}. 

Blocking  of  Tests 

Since  the  intent  of  the  STDS  was  to  create  the  most  diverse  group  of  tests  and  system 
time  constraints,  there  was  blocking  of  tests.to  control  for  variablity.  A  properly  blocked  test 
would  allow  for  statistical  techniques  to  be  used  on  the  test  dau  so  judgements  could  be  made 
about  the  effect  of  changing  the  data  characteristics  (ELINT,  Geographic  Separations).  The 
PTDS  used  blocking  to  control  for  variability.  Three  similar  sets  of  ground  truth  tracks  were 
generated  at  geographic  separation  of  12, 24  and  48  nautical  miles.  Within  each  of  these  sets, 
data  was  generated  which  varied  the  ELINT  separation  by  0,1, 2, 3  and  4  standard  deviations.  At 
each  of  the  resultant  design  points,  five  statistical  repetitions  were  made  creating  a  total  of 
(3)(5)(5)  =  75  tests. 

PARAMETER  SETTINGS 

Two  parameter  setting  were  used  in  this  test  as  shown  in  Table  2.  Both  STDS  and  PTDS 
were  run  under  Parameter  Setting-One  (PS-h)  and  only  STDS,  was  run  under  Parameter  Setting- 
Two  (PS2).  In  its  correlation  process,  OBU  makes  decisions  at  cenain  points  to  "trim"  the  list  of 
candidate  contact  reports  that  could  be  correlated  to  a  given  track  by  computing  a  Measure  of 
Correlation  (MOC)  and  then  checking  whether  the  candidate  is  reasonable  close  to  the  best 
candidate.  The  notion  of  "reasonably  close"  depends  on  the  parameters  (or  thresholds)  in  Table 
2.  In  OBU  terminology,  this  threshold  is  called  the  margin  and  is  theminimum  fraction  of  the 
best  MOC  at  which  a  candidate  will  be  retained.  In  the  case  of  ELINT  and  Spatial  tests,  if  only 
one  repon  is  left  after  this  threshold  test,  that  report  is  assigned  to  the  track.  If  two  or  more 
candidates  still  exist,  the  ACT  may  perform  more  tests  or  decide  the  reports  ambiguities.  So,  if 
this  margin  is  decreased,  one  would  expect  an  eventual  higher  ambiguity  rate  or  a  more  "careful" 
tracker/correlator.  For  the  New  Emitter  Statistic  and  the  New  Track  Threshold,  OBU  is 
basically  testing  the  hypothesis  that  a  track  could  contain  a  new  emitter  or  a  report  could  really 
be  a  new  track  (based  on  the  Spatial  MOC).  If  these  parameters  are  lowered,  one  would  expect 
more  new  emitters  being  declared  and  more  tracks  created.  Other  OBU  parameters  that  could 
have  been  "tweaked"  include  the  Emitter  Update  Threshold  which  decides  how  the  statistical 
attributes  of  a  report  should  be  divided  among  a  multi-emitter  track  when  there  is  a  question  as 
to  which  emitter  a  report  belongs.  For  this  test,  the  Emitter  Update  Threshold  was  set  to  0.50  at 
both  parameter  settings.  Another  parameter  known  as  Frustration  Time  is  a  Multi-Track 
Initiation  (CLUSTER)  parameter  which  specifies  the  amount  of  time  that  should  elapse  before 
which  OBU  will  not  consider  a  declared  ambiguous  repon  as  a  possible  new  track  component. 
This  was  set  at,a  large  enough  time  so  the  parameter  would  have  no  effect  on  processing. 


PARALLEL  TRACKS  DATA  SET  (FTPS)  ANALYSIS 

Table  3  summarizes  results  among  individual  tests.  The  first  element  in  each  row 
describes  the  test,  PAX_PARA  jtyz  where  x  is  the  repetition  number,  y  is  the  geographic 
separation  (If  y=l,  Geo-Sep.  =  12  nautical  miles;  If y  =2,  Geo-Sep  =  24  n.  m.;  If  y=3,  Geo-Sep  = 


4 


48)  and  z  is  the  ELINT  Separation  (ranging  over  0,1,2,3.4  Std.  Deviation  separation).  The  next 
column  is  labeled  NOBS  for  Number  of  Observations  Per  Test  (in  this  case  each  test  had  96 
reports  divided  among  two  tracks).  The  next  column  is  the  Ground  Truth  track  count,  labeled 


PARALLEL  TRACKS  TEST .  PARAMETER  SETTING  I 

NOBS  NOT  NCT  TP  CAR  AR  AVSGT 


_PARA  no 
PARA  111 
PARA  112 
_PARA_1I3 
PARA  114 
PARA  120 
PARA_121 
PARA  122 
PARA  123 
PARA  124 
PARA  130 
PARA  131 
PARA  132 
PARA  133 
PARA  134 
PARA  210 
PARA  211 
PARA  212 
_PARA_213 
PARA  214 
PARA  220 
PARA  221 
PARA  222 
PARA  223 
PARA  224 
PARA  230 
PARA  231 
_PARA_232 
_PARA_233 
_PARA_234 
PARA  310 
_PARA_31l 
_PARA_312 
PARA_313 
PARA  314 
_PARA  320 


2  1.0000 
2  1.0000 
4  0.9630 

3  0.9868 
2  1.0000 
2  1.0000 

4  0.9574 

3  0.9815 
2  1.0000 
2  1.0000 

4  0.9804 
4  1.0000 
2  1.0000 
3  1.0000 
2  1.0000 
2  1.0000 

2  0.9143 
2  1.0000 

3  0.9740 
2  1.0000 
2  1.0000 

2  0.9231 

3  0.9714 
3  0.9744 
2  1.0000 
2  1.0000 
3  0.9524 
3  0.9828 

3  0.9868 
3- 0.9870 
2  1.0000 

4  0.8462 
3  0.9344 
3  0.9846 
3  0.9846 
2  1.0000 


0.6667  1.5000 
0.6354  3.0000 
0.4375  8.5000 
0.2083  7.5000 
0J396  5.0000 
0.6667  1.5000 
0.5104  5.0000 
I  0.4375  8.0000 
I  0.1250  5.5000 
0.1875  5.0000 
0.4688  3.5000 
0.4479  3.5000 
0.2083  6.0000 
0.1250  65000 
0.1146  5.5000 
0.7113  1.0000 
0.6392  4.5000 
0.4433  7.0000 
0.206210.0000 
0.2371  4.5000 
I  0.7010  1.0000 
05979  5.5000 
0.278410.0000 
0.1959  9.5000 
0.2062  5.0000 
,  0.6598  1.0000 
05670  3.5000 
0.4021  9.5000 
1  0.2165  9.5000 
0.2062  9.5000 
0.6875  1.5000 
0.4583  9.0000 
0.364610.0000 
0.3229  7.5000 
;  0.3229  8.0000 
0.6875  1.5000 


PAX.PARA 
PAX  PARA 
PAX.PARA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
•PAX  PARA 
PAX_PARA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
•PAX  PARA 
PAX  PARA 
PAX  PARA 
PAX_PARA 
PAX  PARA 
•PAX  PA.RA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
•PAX  PARA 
•PAX  PARA 
PAX  PARA 
PAX  PARA 
PAX  PARA 
♦PAX.PARA 
•PAX  PARA 
PAX.PARA 
PAX.PARA 
PAX.PARA 
PAX.PARA 
PAX.PARA 
PAX  PARA 
PAX.PARA 
PAX.PARA 


.321  96 
.322  96 
.323  96 
324  96 
330  96 
.331  96 
.332  96 

333  96 

334  96 
.410  96 
.411  96 

412  96 

413  96 

414  96 
420  96 
.421  96 
.422  96 

423  96 

424  96 
.430  96 

431  96 

432  96 
.433  96 

434  96 

510  96 

511  96 
.512  96 

513  96 

514  96 

520  96 

521  96 
.522  96 
.523  96 
.524  96 
530  96 
.531  96 
.532  96 
533  96 
.534  96 


2  0.8136  0.5000  0.385412.0000 

2  0.9688  0.6458  0  3333  8.0000 

3  0.9848  0.6563  03125  7.0000 
3  0.9831  0.6667  03021  8.5000 

2  1.0000  0.5729  0.4271  33000 

3  0.9123  0.5208  0.4063  6.0000 
3  1.0000  0.6334  0.3333  5.3000 
3  0.9859  a6979  03604  83000 
3  0.9861  0.7083  03500  8.0000 
2  0.9412  0.3333  0.6438  23000 

2  0.9762  0.4271  03625  43000 

3  0.9718  0.6667  03604  8.0000  . 
2  1.0000  0.8333  0.1667  5.0000 
2  1.0000  0.8021  0.1979  43000 
2  0.9118  0.3229  0.6458  3.0000 

2  0.9783  0.4688  03208  53000 

3  1.0000  0.6771  03917  73000 
2  1.0000  0.8333  0.16^7  5.0000 
2  1.0000  0.8021  0.1979  4.5000 
2  0.9394  0.3229  0.6563  23000 

2  1.0000  0.6563  0.3438  7.0000 

3  1.0000  0.6771  03917  7.0000 
2  1.0000  0.8958  0.1042  5.0000 
2  1.0000  0.8958  0.1042  5.0000 
2  1.0000  0.3125  0.6875  1.0000 
2  1.0000  0.3125  0.6875  1.0000 
2  0.9636  0.5521  0.4271  93000 
2  0.9848  0.6771  0.312510.0000 

2  1.0000  0.7813  0.2188  4.0000 

3  0.9697  0.3125  0.6563  2.0000 
3  0.9697  0.3125  0.6563  2.0000 
2  0.9821  0.5729  0.4167  9.0000 
2  0.9859  0.7292  0.260411.0000 
2  1.0000  0.8125  0.1875  5.0000 
2  1.0000  0.5000  0.5000  1.0000 
2  1.0000  0.6250  0.3750  23000 
2  0.9868  0.7813  0.2083  53000 
2  0.9884  0.8854  0.1042  6.0000 
2  1.0000  0.8854  0.1146  5.5000 


Table  3.  PwallelTracks Data  Set  -  PS-l 


ELPiT  Sqaiikffl  fin  Stl  Ctt.) 


Figure  2.  Track  Purity  vs.  EUNT  Sep. 


Figure  3.  Track  Purity  vs.  EUNTtGEO 
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PARALLEL  TRACKS  TEST  -  RUN  0NNECTARt4 

NOBS  NOT  NCTTP  CAR  AR  AVSGT 


PAX  PARA  no 
PAX  PARA  111 
PAX  PARA  112 
PAX_PARA  113 
PAX_PARA  114 
PAX  PARA  120 
PAX  PARA  121 
PAX_PARA  122 
PAX  PARA  123 
PAX  PARA^124 
PAX  PARA  130 
PAX  PARA  131 
PAX  PARA_132 
PAX  PARA  133 
PAXIpARA  134 
PAX_PARA_210 
PAX  PARA  211 
PAX  PARA  212 
PAX  PARA  213 
PAX  PARA  214 
PAXJPARA_220 
PAX_PARA  221 
PAX  PARA  222 
PAX  PARA  223 
PAX  PARA  224 
PAX  PARA  230 
PAX  PARA  231 
PAX  PARA  232 
PAX  PARA  233 
PAX  PARA  234 
PAX  PARA  310 
PAX  PARA  311 
PAX.PARA  312 
PAX  PARA  313 
PAX  PARA  314 
PAX.PARA  320 
PAX  PARA  321 


2  0.7604 
2  0.8854 
2  0.9792 
2  0.9896 
2  1.0000 
2  0.9792 
2  0.9792 
2  0.9896 
2  1.0000 
2  1.0000 
2  1.0000 
2  0.9896 
2  1.0000 
2  1.0000 
2  1.0000 
2  0.7113  ( 
2  0.8144  ( 
2  0.9794  ( 
2  0.9897  ( 
2  1.0000 
2  0.9072  ( 
2  0.9175  ( 
2  0.9897  ( 
2  1.0000 
2  1.0000 
2  0.9897  I 
2  1.0000 
2  1.0000 
2  1.0000 
2  1.0000 
2  0J521  I 

2  0.7292  I 

3  0.9271  I 
2  0.9792  I 
2  0.9792  I 
2  1.0000 
2  0.9375  I 


0.0000  7.0000 
0.0000  7.0000 
0.0000  3.0000 

aoooo  20000 
0.0000  1.0000 
0.0000  3.0000 
0.0000  3.0000 
0.0000  20000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  20000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000 12.0000 
0.000011.0000 
0.0000  3.0000 
0.0000  20000 
0.0000  1.0000 
0.0000  4.0000 
0.0000  3.0000 
0.0000  20000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  2.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  8.0000 
;  0.0000 13.0000 
'  0.0000  SiOOO 
;  0.0000  3.0000 
;  0.0000  3.0000 
I  0.0000  1.0000 
;  0.0000  3.0000 


PAX_PARA_322  96 
PAX  PARA  323  96 
PAX  PARA  324  96 
PAX>ARA_330  96 
PAX_PARA  331  96 
PAX  PARA  332  96 
PAX>ARA  333  96 
PAX_PARA  334  96 
PAX  PARA  410  96 
PAX_PARA  411  96 
PAX  PARA_412  96 
PAX  PARA  413  96 
PAX  PARA  414  96 
PAX  PARA  420  96 
PAX  PARA  421  96 
PAX  PARA  422  96 
PAXIpARA_423  96 
PAX  PARA_424  96 
PAX  PARA  430  96 
PAX  PARA_431  96 
PAX  PARA_432  96 
PAX  PARA  433  96 
PAX  PARA  434  96 
PAX  PARA  510  96 
PAX  PARA  511  96 
PAX  PARA  512  96 
PAX  PARA  513  96 
PAX  PARA  514  96 
PAX  PARA  520  96 
PAX  PARA  521  96 
PAX  PARA  522  96 
PAX  PARA  523  96 
PAX  PARA  524  96 
PAX.PARA  530  96 
PAX  PARA  531  96 
PAX  PARA_532  96 
PAX  PARA  533  96 
PAX  PARA  534  96 


2  0.9375  0.9375 

2  0.9896  0.9896 
2  1.0000  1.0000 
2  1.0000  1.0000 
2  1.0000  1.0000 
2  1.0000  1.0000 
2  1.0000  1.0000 
2.1.0000  1.0000 

3  0.8125  0.8021 
3  0.9375  0.9271 
2  0.9688  0.9688 
2  0.9792  0.9792 

2  0.9792  0.9792 

3  0.9688  0.9583 
3  0.9792  0.9688 
3  1.0000  0.9479 
3  1.0000  0.9479 
3  1.0000  0.9479 
3  1.0000  0.9896 
3  1.0000  0.9896. 
3  1.0000  0.9479 
3  1.0000  0.9479 
3  1.0000  0.9479 
3  0.5625  0.5521 
3  0.9063  0.8958 
3  : 0.9479  0.9375 
3  0.9792  0.9688 
3  1.0000  0.9896 
3  0.9896  0.9792 
3  0.7500  0.7396 
3  0.9792  0.9688 
3  0.9792  0.9688 
3  1.0000  0.9896 
3  1.0000  0.9896 
3  1.0000  0.9896 
3  1.0000  0.9896 
3  1.0000  0.9896 
3  1.0000  0.9896 


0.0000  3.0000 
0.0000  20000 
0.0000.1.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  1.0000 
0.0000  1.0000 
aoooo  9.5000 
0.0000  8.0000 
0.0000  3.0000 

aoooo  20000 
0.0000  20000 
0.0000  5.0000 
0.0000  4.0000 
0.0000  1.5000 
0.0000  1.5000 

0.0000  liooo 
0.0000  20000 
0.0000  20000 
0.0000  uooo 

0.0000  IJOOO 
0.0000  1.5000 
0.000011.0000 
0.0000  9.0000 
0.0000  5.0000 
0.0000  4.0000 
0.0000  2.0000 
0.0000  3.0000 
0.0000  7.0000 
0.0000  4.0000 
0.0000  20000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 


Table  4:  NECTAR  ResuUs  on  PDTS 


NGT.  There  are  only  two  tracks  per  test,  so  this  number  is  always  two.  The  fourth  column, 
labeled  NCT,  is  the  Number  of  Constructed  Tracks,  i.e.  the  number  of  tracks  that  OBU  believes 
is  present  in  the  geographic  area  of  the  test.  As  can  be  seen,  OBU  was  occasionally  creating 
extra  tracks  at  this  parameter  setting,  usually  when  the  ELINT  and  Geo-Separation  were 
relatively  low.  The  next  column,  labeled  TP,  is  the  track  purity  measure.  Track  Purity  is  the 
percentage  of  reports  in  a  track  coming  from  a  dominant  uniquely  associated  ground  truth  track 
averaged  over  all  constructed  tracks.  The  next  column,  CAR,  is  the  Correct  Assignment  Ratio, 
which  is  the  percentage  of  ground  truth  reports  assigned  to  a  single, dominant  constructed  track 
averaged  over  all  ground  truth  tracks.  Ambiguity  Rate  (AR)  is  noted  in  the  next  column.  And 
AVSGT  in  the  final  column,  stands  for  the  Average  Segments  Per  Ground  Truth  which 
measures  the  amount  of  discontinuity  in  the  assignment  of  ground  truth  reports  averaged  over 
all  ground  truths.  For  comparison  purposes,  refer  to  Table  4,  which  summarizes  results  of  the 
same  data  (PTDS)  as  run  on  the  in-house  Tracker/Correlator,  NECTAR. 

If  one  reviews  the  results  of  this  test  in  Table  3,  the  high  ambiguity  rate  is  immediately 
noticeable.  At  PS-1,  OBU  has  a  low  ELINT  margin  and  no  spatial  correlation,  so  many  of  the 
reports  in  this  test  (roughly  40%)  were  declared  ambiguous.  Specifically,  when  the  ELINT  and 
Geographic  separation  are  very  low,  OBU  T/C  becomes  confused  and  will  not  assign  reports. 

In  fact,  it  was  determined  prudent  to  drop  all  tests  from  further  analysis  with  an  ambiguity  rate 
greater  than  60%.  Since,  the  fust  15  reports  have  unique  I.Ds  and  each  uack  has  about  50 
reports,  an  ambiguity  rate  of  60%  or  more  would  indicate  that  no  correlation  beyond  the  first  15 
reports  ever  occurred.  Again,  most  of  these  dropped  tests  were  at  low  geographic  and  ELINT 
separation  indices.  In  all,  17  tests  were  dropped  -  they  are  marked  by  stars  in  Table  3. 


The  remaining  data  were  analyzed  for  trends.  First,  consider  the  graph  in  Figure  2.  It 
can  be  seen  that  the  min(Track  Purity)  goes  up  as  the  ELINT  separation  goes  from  one  to  four 
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Overall  Performance  on  STDS 

Measure  of  Performance 

P.S-T 

ps-n 

nectar 

Ambiguity  Rate 

0.4069 

0.0757 

Not  Applicable 

Track  Purity 

0.9507 

0.8923 

0.9091 

Correct  Assignment  Ratio 

0.5632 

0.8060 

0.9120 

Average  Segments  per 

7.67 

8.84 

2.9467 

Ground  Truth 

Table  5:  Overall  Results  for  STDS 


(note:  after  the  seventeen  high-ambiguity  tests  were  removed  fcr  ELINTseparation  =  0).  It  can 
also  be  shown  analytically  that  the  deviation  from  the  mean  within  each  ELINT  separation  is 
decreasing  with  ELINT  separation.  Unfortunately,  due  to  the  large  athbiguity  rate  at  PS-1,  it 
would  not  be  worthwhile  to  come  up  with  regression  equations  for  this  relation,  but  it  should  be 
noted  because  it  indicates  that  the  T/C  is  acting  "rationally"  as  one  would  normally  expect  this 
type  of  relation.  One  can  also  look  at  the  separate  effect  of  geographic  separation  by  creating  a 
function,  [(ELINT  Sep.)(10)  +  the  enumerated  value  for  Geographic  Separation].  This  is 
graphed  in  Figure  4.  Basically  this  shows  us  that  in  addition  to  ELINT  Separation  increasing 
min(Track  Purity),  Geographic  Separation  appears  to  have  a  similar  effect  within  the  ELINT 
Separation  divisions.  Again,  this  can  be  interpreted  that  even  with  the  "loose"  parameterization 
of  PS-1,  the  Tracker/Correlator  is  acting  "rationally"  given  the  aforementioned  conditions. 
Similar  effects  are  not  as  evident  over  the  Average  Segments  Per  Ground  Truth,  though  perhaps 
with  more  repetitions,  this  widely  varying  parameter  might  be  seen  to  center  around  a  mid-point. 
However,  one  can  see  (as  expected)  that  Ambiguity  Rate  decreases  as  geographic  separation  and 
ELINT  separation  increase.  Again,  this  indicates  that  ACT  is  acting  "rationally",  though  as 
compared  with  Table  4,  not  "optimally". 


SENSITIVITY  TEST  DATA  SET  (STDS)  ANALYSIS 


The  STDS  results  allow  the  analyst  a  chance  to  compare  parameter  settings.  As  can  be 
seen  in  Table  5,  the  summary  of  test  results,  there  was  an  unacceptable  amount  of  ambiguities  at 
Parameter  Setting  I  (PS-I)  as  compared  to  Parameter  Setting  II  (PS-II).  Most  likely,  this  is  due  to 
the  low  ELINT  margin  sening  and  the  Spatial  Correlation  being  turned  off.  For  PS-I,  with  the 
high  ambiguity  rate,  it  is  not  surprising  for  the  Track  Purity  to  be  high.  Track  Purity,  afterall,  is 
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Extra  Constructed  Tracks  -  (FS-II) 


0  12  3 

EXTRA-TRACKS 


Figure  4:  Histograms  for  Number  of Extra  Constructed  Tracks  per  Test 
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1  2  3  4  S 


NUMBER  OF  EMITTERS  CONSTRUCTED 


Figure  5:  Histograms  for  Number  of  Emitters  Constructed  per  Track 

the  measure  of  how  many  repons  on  a  constructed  track  come  from  a  single  ground  truth.  In  the 
case  where  the  tracker/correlator  is  being  very  "picky",  it  will  usually  construct  pure  tracks.  The 
Correct  Assignment  Ratio  (CAR)  is  the  measure  of  how  well  each  ground-truth  track  was 
assigned  to  a  constructed  track.  If  TP  =  1.00  and  NCTT  =  NGT  then  1  -  CAR  =  AR. 

At  PS-II,  the  overall  numbers  do  look  better,  though  still  not  up  to  par  with  our  in-house 
O  acker/correlator  (NECTAR).  (It  should  be  noted  that  NECTAR  does  not  declare  ambiguities. 
Instead,  when  presented  conflicting  data,  it  will  create  multiple  hypothesis  and  then  retain  each 
hypothesis  until  other  data  comes  in  to  clarify  the  picture).  At  both  parameter  settings,  it  is  noted 
that  the  Average  Segments  per  Ground  Truth  is  unreasonably  high,  as  compared  to-NECTAR. 
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PS-II  has  a  slightly  higher  overall  AVSGT.  This  can  be  partly  explained  by  the  propensity  of  the 
ACT  to  declare  new  tracks  at  the  given  parameter  settings.  In  Figure  4,  histograms  for  the 
number  of  extra  tracks  per  individual  tests  are  drawn  for  the  different  parameter  settings.  In  the 
case  of  PS-I,  OBU  only  declared  an  extra  track  in  20  (out  of  75)  tests,  however,  at  PS-II,  when  the 
New  Track  Threshold  was  raised  from  0.14  to  0.50,  OBU  declared  up  to  three  extra  tracks  in  39 
out  of  75  tests. 

Similarly,  at  PS-II,  OBU  was  more  prone  to  declare  extra  emitters  on  a  track.  In  Figure  5, 
histograms  for  the  number  of  emitters/track  are  drawn.  At  PS-I,  where  the  New  Emitter  Statistic 
Threshold  was  0.15,  far  fewer  false  emitters  were  declared  than  at  PS-II,  where  the  New  Emitter 
Statistic  was  decreased  to  only  0.14.  One  could  infer  that  the  NEST  is  an  extremely  sensitive 
parameter.  Generally,  the  New  Emitter  test  occurs' before  any  ELINT  or  spatial  correlation,  so  it 
is  hard  to  see  how  changes  in  those  parameters  would  affect  this  result. 


TP  &  CAR  vs.  EUNT  Separation  (PS-II) 


■  Trtdc  I\miy 
^  Correct  Asi.  Ri 


Figure  7:  Track  Purity  &  CAR  vs.  EUNT  Separation  alone  (Parallel  Tracks,  STDS,  PS-II) 


SENSITIVITY  TESTS 
PARALLEL TRACKS 
NOBS  NOT  NCT  TP  CAR  AR 

lAYSfll 


PARAMETER  SETTINGS  I 
PARA_6_0_-reST  100 
PARA_6J_TEST  100 
PARA  6_2_TEST  100 
PARA_6_3_TEST  100 
PARA  6  4_TEST  100 
PAR.\  12  0_TEST  100 
PARA  12  1_TEST  100 
PARA  12  2  TEST  100 
PARA  12  3  TEST  100 
PARA  12  4  TEST  100 
PARA  24  0  TEST  100 
PARA  24  1  TEST  100 
PARA  24  2  TEST  100 
PARA  24  3  TEST  100 
PARA  24  4  TEST  100 
PARA  48  0  TEST  100 
PARA  48  1  TEST  100 
PARA  48  2  TEST  100 
PARA  48  3  TEST  100 
PARA  48  4  TEST  100 


PARAMETER  SETTING  II 

PARA  6  0  TEST  100  2 
PARA  6  LTEST  100  2 
PARA  6  2  TEST  100  2 
PARA  6  3  TEST  100  2 
PARA  6  4  TEST  100  2 
PARA  12  0  TEST  100  2 
PARA  12  1  TEST  100  2 
PARA  12  2  TEST  100  2 
PARA  12  3  TEST  100  2 


2  2  0.7561  0.3100  0S900  8.0000 
2  2  0.8627  0.4400  0.4900 13.0000 
2  3  0.9804  0.4700  0.4900  11.0000 
2  3  1.0000  0.4900  0.5000 10.0000 
2  3  1.0000  0.4900  0.4800  10.5000 
2  2  0.8788  0.2900  0.6700  8.0000 
2  2  0.9070  0.3900  0.5700  10.5000 
2  3  0.9643  0.4800  0.4400 13.0000 
2  2  1.0000  0.5600  0.4400  11.0000 
2  2  I.OOOO  0.5600  0.4400 11.0000 
2  3  0.9286  0.2500  0.7200  6.0000 
2  2  0.9268  0.3800  0,5900  10.0000 
2  2  0.9811  0.5200  0.470011.0000; 
2  3  0.9831  0.5600  0.4100  12S000 
2  2  1.0000  0.5600  0.4400  11.0000 
2  2  0.8438  0.2700  0.6800  6.5000 
2  2  0.9574  0.4500  0S300  11.5000 
2  2  1.0000  0.5600  0.4400  11.0000 
2  2  1.0000  0.5600  0.4400  11.0000 
2  2  1.0000  0.5600  0.4400  11.0000 


2  0.6667  0,5200  0.2200 17.0000 1 

2  0.8404  0.7900  0.0600  13.0000 1 

3  0.9490  0.9000  0.0200  8.0000] 
3  0.9348  0.8400  0.0800  9.5'XX)i 
3  0.9368  0.8700  0.0500  lO.OOCOj 

2  0.6667  0.5400  0.1900  16.5000 
5  0.8298  0.6800  0.0600  21.5000 

3  0.9579  0.9000  0.0500  6.0000 1 
2  0.9462  0.8800  0.0700  8.0000  i 


PARA  12_4_-1EST  100  2 
PARA  24_0_TEST  100  2 
PAR/\  24_1_TEST  100  2 
PARA  24_2  TEST  100  2 
PARA  24_3_TEST  100  2 
PARA  24  4  TEST  100  2 
PARA"48  0  TEST  100  2 
PARA_48_1_TEST  100  2 
PARA  48_2_TEST  100  2 
PARA  48  3_TEST  100  2 
PARA  48  4  TEST  100  2 


NECTAR  RUN 

PARA  6  0  TEST  100  2 
PARA_6  I  TEST  100  2 
PARA  6  2  TEST  lOO  2 
PARA  6  3  TEST  100  2 
PARA  6  4  TEST  100  2 
PARA  12  0  TEST  100  2 
PARA  12  1  TEST  100  2 
PARA  12  2  TEST  100  2 
PARA  12  3  TEST  100  2 
PARA  I2_4  TEST  100  2 
PARA  24  0  TEST  100  2 
PARA  24  1  TEST  100  2 
PARA  24  2  TEST  100  2 
PARA  24  3  TEST  100  2 
PARA  24_4_TEST  100  2 
PARA  48  0  TEST  100  2 
PARA  48_1_TEST  100  2 
PARA  48  2  TEST  100  2 
PARA_48_3_TEST  100  2 

PARA_48_4_TEST  100  2 


4  0.9896  0.8500  0.0400  11.5000 

2  0.6410  0.5000  0.2200  14.0000 

3  0.8072  0.6600  0.170017.5000 
2  0.9882  0.8400  0.1500  7.0000 
2  0.9759  0.8100  0.1700  8.0000 
2  1.0000  0.9000  0.1000  4.0000 

2  0.6437  0.5600  0.1300  8.5000 

3  0.6250  0.5400  0.1200  9.0000 

2  1.0000  0.8600  0.1400  5.5000 

3  1.0000  0.8500  0.1300  6.0000 
2  1.0000  0.9000  0.1000  4.0000 


2  0.6300  0.6900  0.0000  I  I.OOOO 

2  0.7700  0.7700  0.0000  13.0000 

3  0.9400  0.9300  0.0000  7.0000 
2  1.0000  1.0000  0.0000  I.OOOO 
2  1.0000  1.0000  0.0000  1.0000 
2  0.6000  0.6000  0.0000 12.0000 
2  0.8800  0.8800  0.0000  8.0000 
2  0.9500  0.9500  0.0000  4.0000 
2  I.OOOO  1.0000  0.0000  1.0000 
2  1.0000  1.0000  0.0000  1.0000 
2  0.7700  0.7700  0.0000  4.0000 
2  0.8800  0.8800  0.0000  2.0000 
2  1.0000  1.0000  0.0000  1.0000 
2  1.0000  I.OOOO  00000  1.0000 
2  1.0000  1.0000  0.0000  1.0000 
2  1.0000  1.0000  0.0000  1.0000 
2  1.0000  1.0000  0.0000  1.0000 
2  1.0000  1.0000  0.0000  I.OOOO 
2  1.0000  1.0000  0.0000  I.OOOO 

2  1.0000  1.0000  0.0000  l.OOOOj 


Table  7:  Summary  of  Parallel  Tracks  Test  Results  (STDS) 
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Turn  Test  RgsuUs 


The  Turn  Tests  consisted  of  one  target  which  turns  at  varying  angles  halfway  through  the 


TRACK  PURITY  vs.  ELINTIGEO  Sep  (NECTAR) 


-O-  TP.Geo=6(NECrAl 
TP.Gco=12(NECTA 
TP.Geo=24(NECr/' 
TP.Geo=48(NECTiS 


ELINT  Separation  (in  Std.  Dev.'s) 

Figure  8:  Track  Purity  vs.  EUNT/GEO  Separation  (NECTAR) 

scenario.  The  turn  test  results  arc  summarized  in  Table  6.  Examining  the  results  specifically  for 
PS-II,  OBU  does  well  in  handling  turns  of  varying  degree.  This  particular  subset  of  data  had 
the  same  ELINT  reports  laid  out  over  varying  ground  truths  (specified  in  Figure  1),  so  the  fact 


TRACK  PURITY  vs.  ELINTIGEO  (PS-II) 


ELINT  Separation  (in  Std.  Dev.) 


-o-  TP,Gco=6 
TP,  Geo=12 
TP,Geo=24 
TP,  Gco=48 


Figure  9:  Track  Purity  vs.  EUNTlGEO  (PS-II) 

that  results  were  the  same  across  each  turns  suggests  that  OBU  is  acting  consistently  in  its 
assignment  of  rcpons  to  tracks.  On  each  test  though,  OBU  constructed  an  extra  track.  Figure  6 
shows  a  typical  turn  test  from  the  PS-II  runs.  While  the  majority  of  the  reports  were  assigned  to 
one  track  (green),  a  small  track  (red)  also  was  constructed.  Examination  of  the  data  indicated 
that  the  red  track  was  a  slight  outlier  from  the  green  track  data,  so  it  is  not  entirely  unreasonable 
to  construct  it.  For  the  most  pan,  these  tests  indicated  that  single  turns  do  not  confuse  the 
motion  model  given  ELINT  distributions  are  sound. 
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Average  Segments/Ground  Truth  Ambiguity  Rate 


CORRECT  ASSIGNMENT  RATE  vs.  EUNTIGEO  (PS-Il) 


ELINT  Separation  (in  Sid.  Dev.'s) 

Figure  11:  Track  Purity  vs.  EUNTby  Geographic  Separation  (PS-II) 

AMBIGUITY  RATE  vs.  EUNTIGEO  (PS-II) 


AVG  SEGIGROUND  TRUTH  vs.  EUNTIGEO  (PS-II) 


■O-  AVSGT.Geo=6 
AVSGT,Gco=12 
AVSGT.Geo=24 
AVSGT.G(»=48 


0  1  2  3  4  5 

ELINT  Separation 

Figure  13;  Average  Seiments per  CroundTruth  by  ELINT  Separation  by  Geo  Sep.  (PS-II) 
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Parallel  Tracks  Test  Results 

The  Parallel  Tracks  Test  is  designed  to  check  the  ability  of  a  T/G  to  keep  target 
distinguished.  The  two  targets  start  at  widely  separated  GEO  and  move  together.  At  this  point 
the  targets  continue  along  parallel  courses  until  the, test  ends.  (Figure  1.1  shows  the  typicil 
ground  truth  for  these  parallel  tests.)  The  initial  separation  is  required  to  allow  the  T/C  to 
establish  the  fact  that  Acre  arc  two  distinct  targets.  Results  are  summarized  in  Table  7. 

These  ELINT/Spatial  only  runs  were  made  for  GEO  separation  of  6,12,24  and  48 
nautical  miles  and  ELIOT  attribute  separation  of  0,1,2,3  &  4.  The  high  aihbiguity  rate  in  PS-I 


u 

H 

s 

3 

O 

u 

a 


E 

CJ 

c/3 

o 

&0 

a 


> 

< 


AVG  SEGIGROUND  TRUTH  vs  ELINTIGEO  (NECTAR) 


-O-  AVSGT.Geo=6{ND 
AVSGT.Geo=12(NI 
AVSGT.C5co=24(NI 
AVSGT,Geo=48(NI 


0  1  2  3  4  5 

ELINT  Separation  (in  Std.  Dev.) 


Fljure  14:  Average  Segments  per  Ground  Truth  by  ELINT  Sep.  by  Geo  Sep  (NECT AR) 

precludes  any  further  analysis.  However,  in  PS-II,  one  would  expect  results  improve  as  GEO  & 
ELIOT  increase.  This  holds  for  ELIOT  for  the  most  pan.  For  instance,  in  Figure  8,  values  for 
Track  Purity  (TP)  and  Correct  Assignment  Rate  (CAR)  are  plotted  with  respect  to  ELIOT  alone. 
It  is  evident  that  at  low  ELIOT  Separation,  TP  and  CAR  are  low  and  at  ELIOT  separations 
greater  than  two  standard  deviations,  the  solution  appears  to  improve.  If  one  examines  ELINT 
increases  at  each  geographical  separation,  one  would  expect  in  a  rational  tracker/correlaior  that 
one  can  generate  graphs  similar  to  the  NE(3TAR  results  as  in  Figure  8  where  track  purity  is 
graphed  over  the  four  different  geographic  separations  over  ELIOT  separation.  Generally,  the 
TP  increases  faster  when  the  GEO  separation  is  higher.  However,  if  we  look  at  a  similar  graph 
for  the  OBU  runs  at  PS-II,  as  in  Figure  9,  one  can  see  that  the  geographical  separation  plays  a 
similar  role  except  that  Track  Purity  does  notreach  1.0  as  often  as  it  did  for  the  NEdTTAR  runs. 
Also,  note  the  outlier  when  GEO=48,  ELIOT  =  1.  Here,  the  spatial  separation  should  be  large 
enough  to  prevent  a  low  TP;  however  it  appears  that  spatial  information  is  not  playing  as  large  a 
role  as  it  should.  In, Figure  10,  the  actual  constructed  tracks  are  graphed  for  GEO=48, 
ELIOT=1.  As  can  be  seen,  the  predominant  tracks  "green"  and  "r(^",  occasionally  jump  from 
one  ground  truth  to  the  other.  This  can  be  explained  by  the  simple  fact,  that  the  outlier  ELINT 
reports  on  one  track  occasionally  correspond  with  the  ELIOT  distribution  non  the  other  track. 
Why  similar  behaviour  is  not  witnessed  at  lower  GEO  separations  is  a  good  question.  One 
would  think  that  with  more  statistical  repetitions,  this  test  might  prove  to  be  more  of  an 
abberation  than  the  norm.  . 

Figures  11-14  graph  CAR,  Ambiguity  Rate  and  Average  Segments  per  Ground  Truth 
over  ELINT  and  GEO  Separation  for  the  PS-II  tesu  In  Figure  1 1,  the  point  associated  with 
GEO=48,  ELIOT  =1  (Figure  1 1)  is  an  outlier  as  well.  Also,  one  would  expect  a  quicker  rise  in 
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SENSITIVITY  TESTS 
CROSSING  TESTS 

NOBS  NGT  NCT  TP  CAR  AR  AVSGT 


PARAMETER  SETTING  I 
CROSSING_30  0  TEST  9* 
CROSSING  30  TTEST  98 
CROSSING  30JI  TEST  98 
CROSSING  30  3  TEST  98 
CROSSING  30  4  TEST  98 
CROSSING  60  0  TEST  98 
CROSSING  60  1  TEST  98 
CROSSING_60_2  TEST  98 
CROSSING.60.3_TEST  98 
CROSSING  60  4  TEST  98 
CROSSING_90_0_TEST  98 
CROSSING^  1  TEST  98 
CROSSING^^  TEST  98 
CROSSING  90  3  TEST  98 
CROSSING_90  4  TEST  98 


PARAMETER  SETTING  D 
CROSSING  30  OJTEST  98 
CROSSING  30  I  TEST  98 
CROSSING.30J_TEST  98 
CROSSING  30  3  TEST  98 
CROSSING  30  4_TEST  98 


2  2  0.9846  0.6S31  03367  6i000 
2  3  1.0000  0.7857  0.2041  6J000 
2  2  1.0000  08163  0.1837  6J000 
2  2  1.0000  a8163  aiS37  6  0000 
2  2  1.0000  0.8265  ai735  SJOOO 
2  2  1.0000  a7449  0.2551  5S0O0 
2  2  1.0000  0.8163  0.1837.  SiOOO 
2  2  1.0000  a78S7  0.2143  7J000 
2  2  1.0000  a826S  ai73S  5J000 
2  2  1.0000  a826S  0.1735  SJOOO 
2  2  1.0000  a755I  0.2449  5JC00 
2  3  1.0000  0.7143  02755  85000 
2  2  1.0000  08163  0.1837  6.0000 
2  2  1.0000  0.8163  0.1837  55000 
2  2  1.0000  0.7143  0.2857  5.0000 


2  2  0.9890  0.9184  0.0714  35000 
2  3  0.9783  0.8469  00612  8.0000 
2  2  0.9894  0.9490  00408  4.0000 
2  2  1.0000  0.9694  0.0306  25000 
2  2  1.0000  0.9694  0.0306  25000 


CROSSING  60  0  TEST  98 
CROSSING  60  1  TEST  98 
CROSSING.60^  TEST  98 
CROSSING.60  3  TEST  98 
CROSSING  60  4  TEST  98 
CROSSING  90  0  TEST  98 
CROSSING_90  1  TEST  98 
CROSSING_90  2  TEST  98 
CROSSING  90  3  TEST  98 
CROSSING  90  4  TEST  98 


nectar  runs 

CROSSING  30  0  TEST  98 
CROSSING  30  1  TEST  98 
CROSSING  30.^  TEST  98 
CROSSING  30  3  TEST  98 
CROSSING  30  4_TEST  98 
CROSSING_60_0_TEST  98 
CROSSING  60  1  TEST  98 
CROSSING  60  2  TEST  98 
CROSSING  60  3_TEST  98 
CROSSING  60_4_TEST  98 
CROSSING  90  0  TEST  98 
CROSSING  90  1  TEST  98 
CROSSING  90.2_TEST  98 
CROSSING_90_3_TEST  98 
CROSSING_90_4_TEST  98 


2  2  1.0000  a9082  0.0918  4.0000 
2  2  1.0000  a90t2  0.0918  4.0000 
2  2  1.0000  a93U  0.0612  4.0000 
2  2  1.0000  a9286  0.0714  4.0000 
2  2  1.0000  09286  0.0714  4.0000 
2  2  1.0000  0.9490  0.0510  35000 
2  2  1.0000  0.9490  0.0510  35000 
2  2  1.0000  09592  0.0408  3.0000 
2  2  1.0000  0.9592  0.0408  3  0000 
2  2  I.OOOO  0.9286  0.0714  4.0000 


2  2  0.9898  0.9898  0.0000  20000 
2  2  0.9898  0  9898  0.0000  20000 
2  2  1.0000-1.0000  0.0000  1.0000 
2  2  1.0000  1.0000  0.0000  1.0000 
2  2  1.0000  1.0000  0.0000  1.0000 
2  2  0.9898  0.9898  0.0000  20000 
2  2  0.9898  0.9898  0.0000  20000 
2  2  1.0000  l.OCOO  0.0000  1.0000 
2  2  1.0000  1.0000  0.0000  1.0000 
2  2  1.0000  1.0000  0.0000  1.000 
2  2  0.9898  0.9898  0.0000  20000 
2  2  1.0000  1.0000  0.0000  1.0000 
2  2  1.0000  1.0000  0.0000 1.0000 
2  2  1.0000  1.0000  0.0000  1.0000 
2  2  1.0000  1.0000  0.0000  I.OOOO 


Table  ^'.Summarization  of  Crossing  Tracks  Test  (STDS) 


all  of  these  MOPs  as  ELINT  and  GEO  are  inaeased.  In  fact,  GEO  doesn't  make  as  much  a 
difference  in  many  cases  as  it  does  in  say  the  NECTAR  runs.  For  instance,  if  one  compares 
Figure  12  with  Figure  13,  this  becomes  evident  One  would  expect  a  "rational" 
Tracker/Correlator  to  act  as  it  does  in  Figure  14  -  i.e.  at  low  GEO  and  low  ELINT,  there  is 
greater  segmentation  and  at  high  GEO  and  ELINT,  the  segmentation  drops  down  to  the  number 
of  ground  truth  segments  (in  this  case,  two). 

Generally  one  can  conclude  at  the  parameter  settings  (PS-II),  the  T/C  is  ignoring  alot  of 
information  by  not  taking  into  account.spatial  characteristics  of  the  data. 


Crossing  Track  Test  Results 

The  Crossing  Tracks  Test  is  designed  to  check  the  T/C’s  ability  to  distinguish  two  targets 
whose  paths  cross.  The  Crossing  Tracks  Tests  in  the  STDS  used  three  angles,  30®,  60®,  90®  (for 
a  graphical  representation,  see  Figure  1).  There  was  one  one  repetition  of  each  angle  over  five 
different  ELINT  Std.  Dev.  separation:  {0,1,2,3,4}.  The  course  itself  ran  for  ~25  hours  before  the 
targets  met. 

A  "correct"  result  for  this  test  is  successfully  maintaining  the  identity  of  the  two  targets 
as  they  meet  and  then  separate.  Measures  such  as  Track  Purity  (TP)  and  Correct  Assignment 
Ratio  (CAR)  would  not  be  expected  to  be  perfect  because  some  of  the  reports  near  the 


1  SENSITIVITY  TESTS  1 
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9.0000 

PARAMETER  SETTING  I 

STR  TURN  3  2  TEST 

96 

2 

4 

I.OOOO 

0.9167 

0.0104 

8.0000 

STR  TimN  1  0  TEST 

96 

2 

2 

0.9677 

0.3125  0.6771  3.0000 

STR.TURN  4  0  TEST 

96 

2 

4 

0.6264 

05313 

0.0521 

9.5000 

STR  TURN  1  1  TEST 

96 

2 

3 

0.9608 

0.4688  0.4688  9.5000 

STR_TURN.4_1_TEST 

96 

2 

3 

0.6353 

05208 

0.1146 

65000 

STR.TXmN.U.TEST 

96 

2 

3 

0.9821 

05313  0.4167  11.0000 

STR.TURN_4.2_TEST 

96 

2 

2 

1.0000 

0.9792 

0.0208 

I.SOOO 

STR_TURN_2.0_TEST 

96 

2 

2 

05429 

0.3958 

0.2708  5.0000 

STR_TURN_2.1_TEST 

96 

2 

2 

1.0000 

0.7917 

0.2083  5.0000 

NECTAR  RUN 

STR.TURN^J.TEST 

96 

2 

2 

1.0000 

0.8438 

0.1563  60000 

STR  TURN  1  0  TEST 

96 

2 

2 

05104 

05104 

0.0000 

zoooo 

STR  TURN  3  0  TEST 

96 

2 

2 

0.9821 

05729 

0.4167  7.5000 

STR  TURN  1  1  TEST 

96 

2 

2 

0.9896 

0.9896 

00000 

zoooo 

STR  TURN  3  I  TEST 

96 

2 

2 

0.9859 

0.7292 

0.2604  11.0000 

STR  TURN  1  2  TEST 

96 

2 

2 

1.0000 

1.0000 

00000 

1.0000 

STR  TURN.3  2  TEST 

96 

2 

2 

0.9863 

0.7500 

0.2396  100000 

STR  TURN  2  0  TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

zoooo 

STR  TURN  4_0  TEST 

96 

2 

2 

1.0000 

0.4063 

0.5938  4.5000 

STR  TURN  2  1  TEST 

96 

2 

2 

1.0000 

I.OOOO 

0.0000 

1.0000 

STR  TURN  4  1  TEST 

96 

2 

3 

1.0000 

0.6250 

0.3438  9.0000 

STR.TURN  J.2  TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

STR_TURN_4^_TEST 

96 

2 

2 

1.0000 

0.7292 

02708  105000 

STR.TURN  3  0  TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

20000 

STR  TURN  3  1  TEST 

96 

2 

2 

0.9896 

0.9896 

00000 

20000 

STR  TURN  3  2  TEST 

96 

2 

2 

1.0000 

I.OOOO 

0.0000 

I.OOOO 

PARAMETER  SETTING  U 

STR.TURN  4  0  TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

20000 

STRjrURNJ.O.TEST 

96 

2 

5 

0.6742 

0.4583 

0.0729205000 

STR.TURN.4J.TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

20000 

STR  TURN.I_1_TEST 

96 

2 

4 

0.9375 

0.8854 

0.0000  9.0000 

SIR.TURN_4.2.TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

STR.TURN.1.2.TEST 

96 

2 

4 

1.0000 

0.9167 

00104  8.0000 

STR_TURN_2.0.TEST 

96 

2 

3  05402 

0.4792  0.0938  65000  ] 

Table  9:  Summary  of  Straight-Turn  test  results  (STDS ) 
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intersection  of  tv/o  tracks  could  be  legitimately  assignable  to  either  track.  However,  given  the 
performance  of  spatial  correlation  at  these  parameter  settings,  that  might  not  be  as  big  of  a 
problem  as  expected.  Regardless  of  these  considerations,  the  results  are  shown  in  Table  8. 

OBU  did  fairly  well  on  Aese  tests,  maintaining  highly  pure  tracks  while  following  the 
tracks  after  they  crossedl  At  lower  angles,  such  as  30“,  OBU  had  more  trouble  than  at  the  higher 
angles.  In  Figure  15,  the  constructed  tracks  for  the  test  where  angle=30°,  FLINT  separation  =  1 
standard  deviation.  This  test  was  the  only  incidence  in  which  OBU  did  not  compare  well  with 
NECTAR  results.  As  can  be  seen,  the  lower  numbers  are  due  to  the  red  track.  Examination  of 


TURfJ.TUIW.lJJJEST  96 
TXJKN.TURN  2  0  TEST  96 
TURN_'njRN_2  IJIEST  96 
TURN_TURN_2_2jrEST  96 
TURNjrUIW  3  0  tEST  96 
TURN.TURN  3  1  TEST  96 
TURN  TURN  3  J2  TEST  96 


INECTAR  RUN 
TURN  TURN  1  0  TEST  96 
TURN  TURN  1  1  TEST  96 
TURN_TURN.IJ2.TESr  96 
,TURN_TURN.2  0  TEST  96 
TURN  TURN  2  1  TEST  96 
TURN  TURN  J2.2  TEST  96 
TURN  TURN  3  0  TEST  96 
TURN_TTmN_3_l_TEST  96 
TURN_TURN_3_2_TEST  96 


PARAMETER  SETTINC I 
.TURN_TURN_1_0.TEST  96 
TURN  TURN  l.I.TEST  96 
TURN.TURN  IJZ.TEST  96 
TURN  TURNJ2  0  TEST  96 
TURN  TURNJ2.1  TEST  96 
TUR.VTXatN.2.2TEST  96 
TURN  TURN  3.0  TEST  96 
TURN  TURN  S.l.TEST  96 
TURN  TURN  3J2  TEST  96 


PARAMETER  SETTING  H 
TURN  TURN  1  0  TEST  96 
TURN  TURN  1  1  TEST  96 


sensitivity  TESTS 
TURN-TURN  TESTS 

■NOBS  NOT  NCT  TP  CAR  AR  AVSGT 


3  0.8667 
3  0.8500 
3  1.0000 

2  0.9677 

3  0.9821 
2-  3  0.9608 
2  3  0.9677 
2  3  0.9600 
2  3  0.9818 


0.3229 

0.2708 

0.416V 

0.3125 

05521 

0.4792 

0.2917 

0.4375 

05313 


0.5313  8.0000 
0.5833  7.5000 
0.468811.0000 
0.6771  3.0000 
0.4167  8.5000 
0.468811.0000 
0.6771  5.0000 
0.479210.0000 
0.4271  10.0000 


3  0.9535  0.8333  0.1042  8.0000 
2  0.9891  0.9479  0.0417  4.0000 


2  2  0.9785  0.9479 
2  5  0.9462  0.8229 
2  3  0.9368  0.8854 
2  4  1.0000  0.9167 
2  4  05978  05000 
2  3  0.9375  0.8958 
2  4  0.9896  0.9167 


0.0313  3.0000 
0.0313  14.0000 
0.0104  85000 
0.0104  8  0000 
0.0417  120000 
0.0000  95000 
0.0000  85000 


2  3  0.6458  0.4896 
2  3  0.6458  0.4896 
2  3  1.0000  0.8542 
2  2  05104  05104 
2  2  0.9896  0.9896 
2  2  1.0000  1.0000 
2  2  0.9896  0.9896 
2  2  0.9896  0.9896 
2  2  1.0000  1.0000 


0.0000  25000 
0.0000  25000 
0.0000  15000 
0.0000  20000 
0.0000  20000 
0.0000  1  0000 
0.0000  20000 
0.0000  20000 
0.0000  1.0000 


Table  10:  Summary  of  Turn-Turn  Test  Results  (STDS) 


the  data  indicated  this  track  was  created  by  the  CLUSTER  routine  out  of  FLINT  outliers 
(ambiguities).  One  can  speculate  that  had  the.ELINT  and  Spatial  margin  been  higher,  this 
probably  would  not  have  occurred. 


StraighLTurn  and  Turn-Tum  Testing  Results 

Straight-Turn  tests  involve  two  targets.  One  target  moves  on  a  straight  course,  while  the 
second  makes  one  turn.  Of  all  the  possible  ways  a  pair  of  tracks  can  be  configured  for  the 
targets,  four  were  selected  for  the  study  (see  Figure  1).  The  turn  for  the  second  target  occurred 
when  the  two  targets  have  their  closest  approach. 

Results  for  the  Straight-Turn  tests  are  summarized  in  Table  9.  The  first  column  lists 
name  of  the  test,  "STR  TURN";  the  second  number  is  the  number  of  type  of  straight-turn  test 
(corr.  to  Figure  1);  the  third  value  is  the  FLINT  Separation  for  the  test  while  the  rest  of  the 
columns  correspond  with  the  standard  results  format  as  discussed  earlier.  Comparing  the  results 
of  PS-n  with  the  NECTAR  results,  one  can  see  that  the  straight-turn  test  was  much  more 
challenging  for  OBU  at  PS-II  than  the  above  crossing  track  tests  especially  at  low  ELINT 
separation.  Specifically,  STR_TURN_1_0,  STR_TURN_1_1,  STR_TURN_4_0  and 
STR_TURN_4_1  exhibit  values  that  indicate  that  the  ACT  had  problems  with  the  data.  Figure 
16  is  a  graph  of  one  of  these  tests  and  was  representative  of  the  problems  that  occurred  in  all 
tests.  If  one  examines  the  figure,  two  major  mistakes  are  immediately  evident.  In  the  first  half 
of  the  "green"  track,  what  looks  like  "stitching"  has  occured.  Examination  of  the  data  indicates 
that  this  was  caused  by  a  track  created  by  CLUSTERthat  was  later  merged  with  the  "green" 
track  by  LINK.  This  is  a  typical  problem  that  can  occur  if  LINK  can  not  take  into  the  account 
past  history  of  a  track.  The  other  problem  occurred  when  a "  blue"  track  was  overlayed  on  the 
"purple"  track.  Again,  this  was  caused  by  CLUSTER.  Why  LINK  did  not  eventually  merge  the 
track  with  the  "purple"  track  is  a  matter  of  conjecture. 

A  Turn-Turn  test  involves  two  targets  as  well.  Both  make  turns  at  the  closest  point  of 
approach.  Usually,  this  is  one  of  the  more  difficult  tests  for  a  track/correlator.  If  one  examines 
the  results  of  this  round  of  testing  in  Table  10  one  can  see  that  OBU's  performance  exceeded 
that  of  the  NECTAR  in  some  cases.  As  was  shown  earlier,  OBU  seems  to  follow  turns  very 
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well  (see  Turn  Testing)  while  NECTAR  does  well  maintaining  straight  tracks.  Tliis  type 
of  behavior  is  attributable  to  the  different  motion  models  . used  in  the  algorithms. 

The  only  place  where  OBU  did  poorly  t  at  PS-II  was  TURN_TURN_3_0.  This 
was  examined  and  it  was  found  that  GLUSTER/LINK  interactions  caused  similar 
behavior  to  occur  as  was  seen  in  Figure  I6and.discussed  above.  It  should  be  pointed 
out,  though,  that  at  the  low-ELINT  separations,  one  would-expect  a  50%  chance  of 
failure  in  a  "reasonable"  T/C.  The  fact  that  OBU  only  failed  once  should  be  an 
■encouraging  one. 


gONCLUSIONS 

The  methods  used  to  evaluate  the  algorithm  are  sound  and  point  the  developer 
towards  possible  drawbacks  in  his  algorithm  to  be  considered  for  future  development. 
The  idea  of  standard  sets  of  tests  to  test  the  data  fusion  algorithm  at  its  most  fundamental 
level  is  also  prooved  to  be  useful.  It  also  behooves  the  evaluator  to  have  other 
algorithms  with  which  to  baseline  performance  against. 

As  has  been  reiterated  throughout  this  report,  although  OBU  is  making  some 
"irrational"  choices  due  to  LINK  and  CLUSTER,  the  ELINT  correlation  seems  to  be 
functioning  as  well  as  can  be  expected  at  the  current  parameterization.  This  is  contrary  to 
previous  testing  results  (March,  1988)  on  OBU  where  many  mational  correlations  and 
spatial  jumping  was  observed.  It  would  appear  ELINT  correfation-wise,  OBU  is  on  the 
proper  track. 

Based  on  our  previous  knowledge  of  TERES  A  and  OBU,  these  results  indicate 
that  the  parameters  for  ELINT  and  Spatial  correlation  should  probably  be  higher.  A 
future  test  would  test  these  parameters  around  the  0.75  range.  In  fact,  a  proposal  for 
future  testing  has  been  sent  to  SPAWAR  and  is  included  at  the  end  of  this  report.  Also 
attention  should  be  paid  to  the  Nevy  Emitter  Statistic  and  New  Track  Threshold  for 
proper  tuning  after  the  developer  is  convinced  he  is  using  sound  ELINT  and -Spatial 
margins. 
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SUMMARY  FILE 


NOBS 

NGT 

NCT 

TP 

CAR 

AR 

AVSGT 

PAX  PARA  110 

96 

2 

2 

1.0000 

0.3333 

0.6667 

1.5000 

PAX  PARA  -111 

96 

2 

2 

1.0000 

0.3646 

0.6354 

3.0000 

PAX  PARA  112 

96 

2 

4 

0.9630 

0.4688 

0.4375 

8.5000 

PAX  PARA  113 

96 

2 

3 

0.9868 

0.7604 

0.2083 

7.5000 

PAX  PARA  114 

96 

2 

2 

1.0000 

0.7604 

0.2396 

5.0000 

PAX  PARA  -120 

96 

2 

2 

1.0000 

0.3333 

0.6667 

1.5000 

PAX  PARA  121 

96 

2 

4 

0.9574 

0.3542 

0.5104 

5.0000 

PAX  PARA  122 

96 

2 

3 

0.9815 

0.5000 

0.4375 

8.0000 

PAX  PARA  123 

96 

2 

2 

1.0000 

0.8750 

0.1250 

5.5000 

PAX  PARA  124 

96 

2 

2 

1.0000 

0.8125 

0.1875 

5.0000 

PAX  PARA  130 

96 

2 

4 

0.9804 

0.4583 

0.4688 

3.5000 

PAX  PARA  131 

96 

2 

4 

1.0000 

0.4896 

0.4479 

3.5000 

PAX  PARA  132 

96 

2 

2 

1.0000 

0.7917 

0.2083 

6.0000 

PAX  PARA  133 

96 

2 

3 

1.0000 

0.8646 

0.1250 

6.5000 

PAX  PARA  134 

96 

2 

2 

1.0000 

0.8854 

0.1146 

5.5000 

PAX  PARA  210 

97 

2 

2 

1.0000 

0.2387 

0.7113 

1.0000 

PAX  PARA  211 

97 

2 

2 

0.9143 

0.3299 

0.6392 

4.5000 

PAX  PARA  212 

97 

2 

2 

1.0000 

0.5567 

0.4433 

7.0000 

PAX  PARA  213 

97 

2 

3 

0.9740 

0.7526 

0.2062 

10.0000 

PAX  PARA  214 

97 

2 

2 

1.0000 

0.7629 

0.2371 

4.5000 

PAX  PARA  220 

97 

2 

2 

1.0000 

0.2990 

0.7010 

1.0000 

PAX  PARA  221 

97 

2 

2 

0.9231 

0.3711 

0.5979 

5.5000 

PAX  PARA  222 

97 

2 

3 

0.9714 

0.6701 

0.2784 

10.0000 

PAX  PARA  223 

97 

2 

3 

0.9744 

0.7629 

0.1959 

9.5000 

PAX  PARA  224 

97 

2 

2 

1.0000 

0.7938 

0.2062 

5.0000 

PAX  PARA  230 

97 

2 

2 

1.0000 

0.3402 

0.6598 

1.0000 

PAX  PARA  231 

97 

2 

3 

0.9524 

0.3711 

0.5670 

3.5000 

PAX  PARA  232 

97 

2 

3 

0.9828 

0.5567 

0.4021 

9.5000 

PAX  PARA  233 

97 

2 

3 

0.9868 

0.7526 

0.2165 

9.5000 

PAX  PARA  234 

97 

2 

3 

0.9870 

0.7629 

0.2062 

9.5000 

PAX  PARA  310 

96 

2 

2 

1.0000 

0.3125 

0.6875 

1.5000 

PAX  PARA  311 

96 

2 

4 

0.8462 

0.4167 

0.4583 

9.0000 

PAX  PARA  312 

96 

2 

3 

0.9344 

0.5625 

0.3646 

10.0000 

PAX  PARA  313 

96 

2 

3 

0.9846 

0.6458 

0.3229 

7.5000 

PAX  PARA  314 

96 

2 

3 

0.9846 

0.6458 

0.3229 

8.0000 

PAX  PARA  320 

96 

2 

2 

1.0000 

0.3125 

0.6875 

1.5000 

PAX  PARA  321 

96 

2 

2 

0.8136 

0.5000 

0.3854 

12.0000 

PAX  PARA  322 

96 

2 

2 

0.9688 

0.6458 

0.3333 

8.0000 

PAX  PARA  323 

96 

2 

3 

0.9848 

0.6563 

0.3125 

7.0000 

PAX  PARA  324 

96 

2 

3 

0.9851 

0.6667 

0.3021 

8.5000 

PAX  PARA  330 

96 

2 

2 

1.0000 

0.5729 

0.4271 

3.5000 

PAX  PARA  331 

96 

2 

3 

0.9123 

0.5208 

0.4063 

6.0000 

PAX  PARA  332 

96 

2 

3 

1.0000 

0.6354 

0.3333 

5.5000 

PAX  PARA  333 

96 

2 

3 

0.9859 

0.6979 

0.2604 

8.5000 

PAX  PARA  334 

96 

2 

3 

0.9861 

0.7083 

0.2500 

8.0000 

PAX  PARA  410 

96 

2 

2 

0.9412 

0.3333 

0.6458 

2.5000 

PAX  PARA  411 

96 

2 

2 

0.9762 

0.4271 

0.5625 

4.5000 

PAX  PARA  412 

96 

2 

3 

0.9718 

0.6667 

0.2604 

8.0000 

PAX  PARA  413 

96 

2 

2 

1.0000 

0.8333 

0.1667 

5.0000 

PAX  PARA  414 

•  96 

2 

2 

1.0000 

0.8021 

0.1979 

4.5000 

PAX  PARA  420 

96 

2 

2 

0.9118 

0.3229 

0.6458 

3.0000 

PAX  PARA  421 

96 

2 

2 

0.9783 

0.4688 

0.5208 

5.5000 

PAX  PARA  422 

96 

2 

3 

1.0000 

0.6771 

0.2917 

7.5000 

PAX  PARA  423 

96 

2 

2 

1.0000 

0.8333 

0.1667 

5.0000 

PAX  PARA  424 

S6 

2 

2 

1.0000 

0.8021 

0.1979 

4.5000 

PAX  PARA  430 

96 

2 

2 

0.9394 

0.3229 

0.6563 

2.5000 

PAX  PARA  431 

96 

2 

2 

1.0000 

0.6563 

0.3438 

7.0000 

PAX  PARA  432 

96 

2 

3 

1.0000 

0.6771 

0.2917 

7.0000 

PAX  PARA'  433 

?6 

2 

2 

1.0000 

0.8958 

0.1042 

5.0000 

PAX  PARA  434 

96 

2 

2 

1.0000 

0.8958 

0.1042 

5.0000 

PAX  PARA  510 

96 

2 

2 

1.0000 

0.3125 

0.6875 

1.0000 
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PAX  PARA  511 

96 

2 

2 

1.0000 

0.3125 

0.6875 

1.0000 

PAX  PARA  512 

96 

2 

2 

0.9636 

0.5521 

0.4271 

9.5000 

PAX  PARA  513 

96 

2 

2 

0.9848 

0.6771 

0.3125 

10.0000 

PAX  PARA  514 

96 

2 

2 

1.0000 

0.7813 

0.2188 

4.0000 

PAX  PARA  520 

96 

2 

3 

0.9697 

0.3125 

0.6563 

2.0000 

PAX  PARA  521 

96 

2 

3 

0.9697 

0.3125 

0.6563 

2.0000 

PAX  PARA  522 

96 

2 

2 

0.9821 

0.5729 

0.4167 

9.0000 

PAX  PARA  523 

96 

2 

2 

0. 9859 

0.7292 

0.2604 

11.0000 

PAX  PARA  524 

96 

2 

2 

1.0000 

0.8125 

0.1875 

5.0000 

PAX  PARA  530 

96 

2 

2 

1.0000 

0.5000 

0.5000 

1.0000 

PAX  PARA  531 

96 

2 

2 

1.0000 

0.6250 

0.3750 

2.5000 

PAX  PARA  532 

96 

2 

2 

0.9868 

0.7813 

0.2083 

5.5000 

PAX  PARA  533 

96 

2 

2 

0.9884 

0.8854 

0.1042 

6.0000 

PAX  PARA  534 

96 

2 

2 

1.0000 

0.8854 

0.1146 

5.5000 
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SUMMARY  FILE  (PS-I) 


NOBS 

NGT 

NCT 

TP 

CAR 

AR 

AVSGT 

CROSSING  30,  0 

TEST 

98 

2 

2 

0.9846 

0.6531 

0.3367 

6.5000 

CROSSING  30  1 

TEST 

98 

2 

3 

1.0000 

0.7857 

0.2041 

6.5000 

CROSSING  30-  2 

TEST 

98 

2 

2 

1.0000 

0.8163 

0.1837 

6.5000 

CROSSING  30  3 

TEST 

98 

2 

2 

1.0000 

0.8163 

0.1837 

6.0000 

CROSSING  30  4 

TEST 

98 

2 

2 

1.0000 

0.8265 

0.1735 

5.5000 

CROSSING  60  0 

TEST 

98 

2 

2 

1.0000 

0.7449 

0.2551 

5.5000 

CROSSING  60  1 

TEST 

98 

2 

2 

1.0000 

0.8163 

0.1837 

5.5000 

CROSSING  60  2“ 

TEST 

98 

2 

2 

1.0000 

0.7857 

0.2143 

7.5000 

CROSSING  60 -3 

TEST 

98 

2 

2 

1.0000 

0.8265 

0.1735 

5.5000 

CROSSING  60  4“ 

TEST 

98 

2 

2 

1.0000 

0.8265 

0.1735 

5.5000 

CROSSING  90  0 

TEST 

98 

2 

2 

1.0000 

0.7551 

0.2449 

5.5000 

CROSSING  90  1 

TEST 

98 

2 

3 

1.0000 

0.7143 

0.2755 

8.5000 

CROSSING  90  2" 

'TEST 

98 

2 

2 

1.0000 

0.8163 

0.1837 

6.0000 

CROSSING  90  3~ 

TEST 

98 

2 

2 

1.0000 

0.8163 

0.1837 

5.5000 

CROSSING  90  4 

TEST 

98 

2 

2 

1.0000 

0.7143 

0.2857 

5.0000 

GEO  1  T2“ 

TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

GEO  1  24" 

'TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

GEO  T  6" 

'TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

GEO  1  T2" 

’TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

GEO  2  24“ 

'TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

GEO  1  6“ 

"TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

PARA  12  0“ 

'TEST 

100 

2 

2 

0.8788 

0.2900 

0.6700 

8.0000 

PARA  12  1 

'TEST 

100 

2 

2 

0.9070 

0.3900 

0.5700 

10.5000 

PARA  12  2" 

"TEST 

100 

2 

3 

0.9643 

0.4800 

0.4400 

13.0000 

PARA  12  3" 

"TEST 

100 

2 

2 

1.0000 

0.5600 

0.4400 

11.0000 

PARA  12  4 

TEST 

100 

2 

2 

1.0000 

0.5600 

0.4400 

11.0000 

PARA  24  0" 

"TEST 

100 

2 

3 

0.9286 

0.2500 

0.7200 

6.0000 

PARA  24  r 

TEST 

100 

2 

2 

0.9268 

0.3800 

0.5900 

10.0000 

PARA  24  2‘ 

TEST 

100 

2 

2 

0.9811 

0.5200 

0.4700 

11.0000 

PARA  24  3' 

TEST 

100 

2 

3 

0.9831 

0.5600 

0.4100 

12.5000 

PARA  24  4' 

"TEST 

100 

2 

2 

1.0000 

0.5600 

0.4400 

11.0000 

PARA  48  0 

"TEST 

100 

2 

2 

0.8438 

0.2700 

0.6800 

6.5000 

PARA  48  1 

"TEST 

100 

2 

2 

0.9574 

0.4500 

0.5300 

11.5000 

PARA  48  2 

"TEST 

100 

2 

2 

1.0000 

0.5600 

0.4400 

11.0000 

PARA  48  3 

"TEST 

100 

2 

2 

1.0000 

0.5600 

0.4400 

11.0000 

PARA  48  4 

"TEST 

100 

2 

2 

1.0000 

0.5600 

0.4400 

11.0000 

PARA  6  0 

"TEST 

100 

2 

2 

0.7561 

0.3100 

0.5900 

8.0000 

PARA  6  1 

"TEST 

100 

2 

2 

0.8627 

0.4400 

0.4900 

13.0000 

PARA  6  2 

TEST 

100 

2 

3 

0.9804 

0.4700 

0.4900 

11.0000 

PARA  6  3 

TEST 

100 

2 

3 

1.0000 

0.4900 

0.5000 

10.0000 

PARA  6  4 

TEST 

100 

2 

3 

1.0000 

0.4900 

0.4800 

10.5000 

REF  1 

TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

REF  2 

TEST 

100 

2 

2 

0.8387 

0.2600 

0.6900 

7.5000 

STR  TURN  1  0 

TEST 

96 

2 

2 

0.9677 

0.3125 

0.6771 

3.0000 

STR  TURN  1  1 

TEST 

96 

2 

3 

0.9608 

0.4688 

0.4688 

9.5000 

STR  TURN  1  2 

TEST 

96 

2 

3 

0.9821 

0.5313 

0.4167 

11.0000 

STR  TURN  2  0 

"TEST 

96 

2 

2 

0.5429 

0.3958 

0.2708 

5.0000 

STR  TURN  2  1 

TEST 

96 

2 

2 

1.0000 

0.7917 

0.2083 

5.0000 

STR  TURN  2  2 

TEST 

96 

2 

2 

1.0000 

0.8438 

0.1563 

6.0000 

STR  TURN  3  0 

TEST 

96 

2 

2 

0.9821 

0.5729 

0.4167 

7.5000 

STR  TURN  3  1 

TEST 

96 

2 

2 

0.9859 

0.7292 

0.2604 

11.0000 

STR  TURN  3  2 

TEST 

96 

2 

2 

0.9863 

0.7500 

0.2396 

10.0000 

STR  TURN  4  0 

TEST 

96 

2 

2 

1.0000 

0.4063 

0.5938 

4.5000 

STR  TURN  4  1 

TEST 

96 

2 

3 

1.0000 

0.6250 

0.3438 

9.0000 

STR  TURN  4  2 

TEST 

96 

2 

2 

1.0000 

0.7292 

0.2708 

10.5000 

TRACK  INIT 

TEST 

ise 

4 

5 

0.6909 

0.2949 

0.6474 

6.7500 

TURN  10 

TEST 

48 

1 

1 

1.0000 

0.5625 

0.4375 

5.0000 

TURN  1 

TEST 

48 

1 

i 

1.0000 

0.8958 

0.1042 

4.0000 

TURN  2 

TEST 

48 

1 

1 

1.0000 

0.8958 

0.1042 

4.0000 

TURN  3 

TEST 

48 

1 

1 

1.0000 

0.8958 

0.1042 

4.0000 

TURN  4' 

TEST 

48 

1 

1 

1.0000 

0.8125 

0.1875 

6.0000 

24 


TURN_5_TEST 
TURN_6_TEST 
TURN_7_TEST 
TURN_8_TEST 
TURN_9_TEST 
TURN  TURNi_l_O^TEST 
TURN  TURN_1_1_TEST 
TURN_,TURN^1_2_TEST 
TURN_TURN_2_0_TEST 
TURN_TURN_.2_1_T-ES,T 
TURN.  TURN_2^2_TEST 
TURN  TURN_3_0_TEST 
TURN  TURN_3_1^TEST 
TURN  TURN_3_2_TEST 


48 

1 

1 

1.0000 

0.7708 

48 

1 

1 

1.0000 

0.8542 

48 

1 

1 

1.0000 

0.8333 

48 

1 

1 

1.0000 

0.8542 

48 

1 

1 

1.0000 

0.8542 

96 

2 

3 

0.8667 

0.3229 

96 

2 

3 

0.8500 

0.2708 

96 

2 

3 

1.0000 

0.4167 

96 

2 

2 

0.9677 

0.3125 

96 

2 

3 

0.9821 

0.5521 

96 

2 

3 

0.9608 

0.4792 

96 

2 

3 

0.9677 

0.2917 

96 

2 

3 

0.9600 

0.4375 

96 

2 

3 

0.9818 

0-.5313 

0.2292  8.0000 
0.1458  3.0000 
0.1667  4.0000 
0.1458  3.0000 
0.1458  3.0000 
0.5313  8.0000 
0.5833  7,.  5000 
0.4688  11.0000 
0.6771  3.0000 
0.4167  8.5000 
0.4688  11.0000 
0.6771  5.0000 
0.4792  10.0000 
0.4271  10.0000 
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SUMMARY  FILE  (PS-II) 


NOBS  NGT  NOT  TP  CAR  AR  AVSGT 


CROSSING_3  0_0_TEST 
CROSSING_3  0_1_TEST 
CROSSING_30_2__TEST 
CROSSING_30_3_,TEST 
eROSSING_30_4_TEST 
CROSSING^e  0_0_TEST 
CROSSING_60_1_TEST 
CROSSING_60_2_TEST 
CROSSING_^6  0_3_TEST 
.  CROSSING_60_4_TEST 
CROSSING_90_0_TEST 
CROSSING_90_1_TEST 
CROSSING_90_2_TEST 
CROSSING_90_3_TEST 
CROSSING_90  4_TEST 
GE0_1_T2__TEST 
GEO  1-24_TEST 
GE^  T  6_TEST 
GE0_2_T2_TEST 
GEO_2  24_TEST 
GEO  ■2_6_TEST 
PARA_T2_0_TEST 
PARA_12_1_TEST 
PARA_12_2_TEST 
PARA_12_3_TEST 
PARA_12_4_TEST 
PARA_24_0_TEST 
PARA_24_1_TEST 
PARA_24_2_TEST 
PARA_24_3_TEST 
PARA_24_4_TEST 
PARA_48_0_TEST 
PARA_48_1_TEST 
PARA  48_2  TEST 
PARA_48_3_TEST 
PARA_48_4_TEST 
PARA_6_0_TEST 
PARA_6_1_TEST 
PARA_6_2_TEST 
PARA_6_3_TEST 
PARA_6_4_TEST 
REF_1_TEST 
REF  2_TEST 
STR_TURN_r'0_TEST 
STR_TURN_1"1_TEST 
STR_TURN_1_2_TEST 
STR_TURN_2_0_TEST 
STR_TURN_2_1_TEST 
STR_TURN_2_2_TEST 
STR_TURN_3_0_TEST 
STR_TURN_3_1_TEST 
STR_TURN_3_2_TEST 
STR_TURN_4_0_TEST 
STR_TURN_4_1_TEST 
STR_TURN_4  2_TEST 

track_inTt_test 

TURN_10_TEST 
TURN_1_TEST 
TURN_2_TEST 
TURN_3_TEST 
TURN  4  TEST  48  1  2 


0.9890 

0.9184 

0.0714 

3.5000 

0.9783 

0.8469 

-0.0612 

8.0000 

0.9894 

0.9490 

0.0408 

4.0000 

1.0000 

0.9694 

0.0306 

2.5000 

1.0000 

0.9694 

0.0306 

2.5000 

1.0000 

0.9082 

0.0918 

4. 0000 

1.0000 

0.9082 

0.0918 

4.0000 

1.0000 

0.9388 

0.0612 

4.0000 

1.0000 

0.9286 

0.0714 

4.0000 

1.0000 

0.9286 

0.0714 

4.0000 

1.0000 

0.9490 

0.0510 

3.5000 

1.0000 

0.9490 

0.0510 

3.5000 

1.0000 

0.9592 

0.0408 

3.0000 

1.0000 

0.9592 

0.0408 

3.0000 

1.0000 

0.9286 

0.0714 

4.0000 

0.6829 

0.5600 

0.1800 

19.0000 

0.6375 

0.5100 

0.2000 

16.5000 

0.6625 

0.5300 

0.2000 

19.0000 

0.6829 

0.5600 

0.1800 

19.0000 

0.6375 

0.5100 

0.2000 

16.5000 

0.6625 

0.5300 

0.2000 

19.0000 

0.6667 

0.5400 

0.1900 

16.5000 

0.8298 

0.6800 

0.0600 

21.5000 

0.9579 

0.9000 

0.0500 

6.0000 

0.9462 

0.8800 

0.0700 

8.0000 

0.9896 

0.8500 

0.0400 

11.5000 

0.6410 

0.5000 

0.2200 

14.0000 

0.8072 

0.6600 

0.1700 

17,5000 

0.9882 

0.8400 

0.1500 

7.0000 

0.9759 

0.8100 

0.1700 

8.0000 

1.0000 

0.9000 

0.1000 

4.0000 

0.6437 

0.5600 

0.1300 

8.5000 

0.6250 

0.5400 

0.1200 

9.0000 

1.0000 

0.8600 

0.1400 

5.5000 

1.0000 

0.8500 

0.1300 

6.0000 

1.0000 

0.9000 

0.1000 

4.0000 

0.6667 

0.5200 

0.2200 

17.0000 

0.8404 

0.7900 

0.0600 

13.0000 

0.9490 

0.9000 

0.0200 

8.0000 

0.9348 

0.8400 

0.0800 

9.5000 

0.9368 

0.8700 

0.0500 

10.0000 

0.7051 

0.5400 

0.2200 

18.0000 

0.6867 

0.5700 

0.1700 

18.5000 

0.6742 

0.4583 

0.0729 

20.5000 

0.9375 

0.8854 

0.0000 

9.0000 

1.0000 

0.9167 

0.0104 

8.0000 

0.5402 

0.4792 

0.0938 

6.5000 

1.0000 

0.9479 

0.0208 

5.0000 

0.9894 

0.9375 

0.0208 

6.0000 

0.9247 

0.8646 

0.0313 

10.5000 

0.9375 

0.8958 

0.0000 

9.0000 

1.0000 

0.9167 

0.0104 

8.0000 

0.6264 

0.5313 

0.0521 

9.5000 

0.6353 

0.5208 

0.1146 

6.5000 

1.0000 

0.9792 

0.0208 

1.5000 

0.6149 

0.7756 

0.0513 

10.0000 

1.0000 

0.9167 

0.0208 

7.0000 

1.0000 

0.9167 

0.0208 

7.0000 

1.0000 

0.9167 

0.0208 

7.0000 

1.0000 

0.9167 

0.0208 

7.0000 

1.0000 

0.9167 

0.0208 

7.0000 

98  2  2 

98  2  3 

98  2  2 

98  2  2 

98  2  2 

98  2  2 

■98  2  2 

98  2  2 

98  2  2 

98  2  2 

98  2  2 

98  2  2 

98  2  .2 

98  2  2 

98  2  2 

100  2  2 

100  2  2 

100  2-2 

100  2  2 

100  2  2 

100  2  2 

100  2  2 

100  2  5 

100  2  3 

100  2  2 

100  2  4 

100  2  2 

100  2  3 

100  2  2 

100  2  2 

100  2  2 

100  2  2 

100  2  3 

100  2  2 

100  2  3 

100  2  2 

100  2  2 

100  2  2 

100  2  3 

100  2  3 

100  2  3 

100  2  3 

100  2  2 

96  2  5 

96  2  4 

96  2  4 

96  2  3 

96  2  3 

96  2  3 

96  2  3 

96  2  4 

96  2  4 

96  2  4 

96  2  3 

96  2  2 

156  4  4 

48  1  2 

48  1  2 

48  1  2 

48  1  2 
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TURN  5  TEST 

48 

1 

2 

1.0000 

0.9167 

0.0208 

7.0000 

TURN  6  TEST 

48 

1 

2 

1.0000 

0.9167 

0.0208 

7.0000 

TURN  7  TEST 

48 

1 

2 

1.0000 

0.9167 

0.0208 

7.0000 

TURN  .8.  TEST 

48 

1 

2 

1.0000 

0.9167 

0.0208 

7.0000 

TURN  9  TEST 

48 

1 

2 

1.0000 

0.9167 

0.0208 

7.0000 

TURN  TURN  10  TEST 

96 

2 

3 

0.9535 

0.8333 

0.1042 

8.0000 

TURN  TURN  1  1  TEST 

96 

2 

2 

0.9891 

0.9479 

0 . 0417 

4.0000 

TURN-  TURN  1  2  TEST 

96 

2 

2 

0.9785 

0;9479 

0.0313 

3.0000 

TURN  TURN  2  0-  TEST 

96 

2 

5 

0.9462 

0.8229 

0.0313 

14.0000 

TURN  TURN  2  1  TEST 

96 

2 

3 

0.9368 

O'.  8854 

0.0104 

8.5000 

TURN  TURN  2  2  TEST 

96 

2 

4 

1.0000 

0.9167 

0.0104 

8.0000 

TURN-  TURN  3  0  TEST 

96 

2 

4 

0.5978 

0.5000 

0.0417 

12.0000 

TURN  TURN  3’  1  TEST 

96 

2 

3 

0.9375 

0.8958 

0.0000 

9.5000 

TURN  TURN  3 ,2  TEST 

96 

2 

4 

0.9896' 

0.9167 

0;0000 

8.5000 
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NECTAR14  RUNS  FROM  1/11/89 

SUMMARY  FILE 


NOBS 

NGT 

NCT 

TP 

CAR 

AR 

AVSGT 

CROSSING  30  0 

TEST 

98 

2 

2 

0.5000 

0.5306 

0.0000 

2.0000 

CROSSING.  30  1" 

TEST 

98 

2 

2 

0.9898 

0.9898 

0;.  0000 

2.0000 

CROSSING  30  2. 

TEST 

98 

2 

2 

1.-0000 

1.0000 

0.0000 

1.0000 

CROSSING:  30  3. 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING-  30  4 

TEST 

98. 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING  60  0" 

TEST 

98 

2 

.2 

0.9898 

0.9898 

0.0000 

2.0000 

CROSSING  60-  1" 

TEST 

98 

2 

2 

0.9898 

0.9898. 

0.0000 

2.0000 

CROSSING  60  2" 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING  60  3 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING  60  4 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING  90  0" 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING  90  .1" 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING  90  2 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING .90  3“ 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

CROSSING  90  4 

TEST 

98 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

GEO  1  T2" 

"TEST 

100 

2 

2 

0.6100 

0.6100 

0.0000 

12.5000 

GEO  1  24“ 

'TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

GEO  T  6“ 

'TEST 

100 

2 

2 

0.6300 

0.6300 

0.0000 

13.5000 

GEO  7  T2“ 

'TEST 

100 

2 

2 

0.6100 

0.6100 

0.0000 

12.5000 

GEO  2  24 

'TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

GEO  i?  6“ 

'TEST 

100 

2 

2 

0.6700 

0.6700 

0.0000 

12.5000 

PARA  T2  0“ 

'TEST 

100 

2 

2 

0.6800 

0.6800 

0.0000 

14.5000 

PARA  12  r 

'test 

100 

2 

2 

0.8500 

0.8500 

0.0000 

10.0000 

PARA  12  2“ 

"TEST 

100 

2 

2 

0.9700 

0.9700 

0.0000 

3.0000 

PARA  12  3“ 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  12  4“ 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  24  0" 

TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  24  r 

TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  24  2 

TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  24  3‘ 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  24  4" 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  48  O' 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  48  r 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  48  2 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  48  3 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  48  4 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PARA  6  0 

"TEST 

100 

2 

2 

0.6600 

0.6600 

0.0000 

14.5000 

PARA  6  1 

"TEST 

100 

2 

2 

0.7700 

0.7700 

0.0000 

12.5000 

PARA  6  2 

TEST 

100 

2 

2 

0.9500 

0.9500 

0.0000 

5.0000 

PARA  6  3 

"TEST 

100 

2 

2 

0.9900 

0.9900 

0.0000 

2.0000 

PARA  6  4 

"TEST 

100 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

REF  1 

"TEST 

100 

2 

2 

0.6100 

0.6100 

0.0000 

12.5000 

REF  2 

TEST 

100 

2 

2 

0.6100 

0.6100 

0.0000 

12.5000 

STR  TURN  1  0 

TEST 

96 

2 

2 

0.5104 

0.5104 

0.0000 

2.0000 

STR  TURN  1  1 

TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

STR  TURN  1  2 

"TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

STR  TURN  2  0 

TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

STR  TURN  2  1 

TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

STR  TURN  2  2 

TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

STR  TURN  3  0 

TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

STR  TURN  3  1 

"TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

STR  TURN  3  2 

TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

STR  TURN  4  0 

TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

STR  TURN  4  1 

TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

STR  TURN  4  2 

TEST 

96 

2 

2. 

1.0000 

1.0000 

0.0000 

1.0000 

TRACK  INIT 

TEST 

156 

4 

1 

0.3077 

1.0000 

0.0000 

1.0000 

TURN  10 

TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  ] 

TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  2 

TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  3 

TEST 

48 

1 

i 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  4' 

TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000 

28 


TURN  5  TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000. 

TURN  6  TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  7  TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  8  TEST 

48 

1 

1 

1.0000 

1,0000 

0.0000 

1.0000 

TURN  9  TEST 

48 

1 

1 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  TURN  1  0  TEST 

96 

2 

2 

0.5104 

0.5104 

0.0000 

2.0000 

TURN  TURN  1  1  TEST 

96 

2 

2- 

0.5104 

0.5104 

0.0000 

2.0000 

TURN^TURN  1.2  TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  TURN  2  0  TEST 

96 

2 

2 

0.5104 

0.5104 

0.0000 

2.0000 

TURN  TURN  2  1  TEST 

96 

2 

,2 

0.9896 

0.9896 

0.0000 

2.0000 

TURN  TURN  2  2  TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

TURN  TURN  3  0;  TEST 

96 

2 

2- 

0.9896 

0.9896 

0.0000 

2.0000 

TURN  TURN  3  1  TEST 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

TURN  TURN  3  2  TEST 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 
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THESE  .RUNS  WERE  MADE  WITH  THE  CORRECTIONS  TO  NECTAR  IN  NECTAR14 


SUMMARY  FILE 


NOBS 

NOT 

NCT 

TP 

CAR 

AR 

AVSGT 

PAX  PARA  110 

96 

2 

2 

0.7604 

0.7604 

0.0000 

7.0000 

PAX  PARA  111 

96 

,2 

2 

0.8854 

0.8854 

0.0000 

7.0000 

PAX  PARA  112 

96 

2 

2 

0.9792 

0.9792 

0.0000 

3.0000 

PAX  PARA-  113 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

PAX  PARA. 114 

96 

2 

2 

1.0000 

1.0000 

,0.0000 

1.0000 

PAX  PARA  120 

96 

2 

2 

0.9792 

0.9792 

0.0000 

3.0000 

PAX  PARA  121 

96 

2 

2 

0.9792 

0.9792 

0.0000 

3.0000 

PAX  PARA  122 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

PAX  PARA  123 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  124 

96 

2 

2 

i.oodo 

1.0000 

0.0000 

1.0000 

PAX  PARA  130 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  131 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

PAX  PARA  132 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  133 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  134 

96 

2 

2 

1.0000 

1.0000 

0.0000 

■  1.0000 

PAX  PARA  210 

97 

2 

2 

0.7113 

0.7113 

0.0000 

12.0000 

PAX  PARA  211 

97 

2 

2 

0.8144 

0.8144 

0.0000 

11.0000 

PAX  PARA  212 

97 

2 

2 

0.9794 

0.9794 

0.0000 

3.0000 

PAX  PARA  213 

97 

2 

2 

0.9897 

■0.9897 

0.0000 

2.0000 

PAX  PARA  214 

97 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  220 

97 

2 

2 

0.9072 

0.9072 

0.0000 

4.0000 

PAX  PARA  221 

97 

2 

2 

0.9175 

0.9175 

0.0000 

3.0000 

PAX  PARA  222 

97 

2 

2 

0.9897 

0.9897 

0.0000 

2.0000 

PAX  PARA  223 

97 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  224 

97 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  230 

97 

2 

2 

0.9897 

0.9897 

0.0000 

2.0000 

PAX  PARA  231 

97 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  232 

97 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  233 

97 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  234 

97 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  310 

96 

2 

2 

0.5521 

0.5521 

0.0000 

8.0000 

PAX  PARA  311 

96 

2 

2 

0.7292 

0.7292 

0.0000 

13.0000 

PAX  PARA  312 

96 

2 

3 

0.9271 

0.9167 

0.0000 

8.5000 

PAX  PARA  313 

96 

2 

2 

0.9792 

0.9792 

0.0000 

3.0000 

PAX  PARA  314 

96 

2 

2 

0.9792 

0.9792 

0.0000 

3.0000 

PAX  PARA  320 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  321 

96 

2 

2 

0.9375 

0.9375 

0.0000 

3.0000 

PAX  PARA  322 

96 

2 

2 

0.9375 

0.9375 

0.0000 

3.0000 

PAX  PARA  323 

96 

2 

2 

0.9896 

0.9896 

0.0000 

2.0000 

PAX  PARA  324 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  330 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  331 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA.  332 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  333 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  334 

96 

2 

2 

1.0000 

1.0000 

0.0000 

1.0000 

PAX  PARA  410 

96 

2 

3 

0.8125 

0.8021 

0.0000 

9.5000 

PAX  PARA  411 

96 

2 

3 

0.9375 

0.9271 

0.0000 

8.0000 

PAX  PARA  412 

■  96 

2 

2 

0.9688 

0.9688 

0.0000 

3.0000 

PAX  PARA  413 

96 

2 

2 

0.9792 

0.9792 

0.0000 

2.0000 

PAX  PARA  414 

96 

2 

2 

0.9792 

0.9792 

0.0000 

2.0000 

PAX  PARA  420 

96 

2 

3 

0.9688 

0.9583 

0.0000 

5.0000 

PAX  PARA  421 

96 

2 

3 

0.9792 

0.9688 

0.0000 

4.0000 

PAX  PARA  422 

96 

2 

3 

1.0000 

0.9479 

0.0000 

1.5000 

PAX  PARA  423 

96 

2 

3 

1.0000 

0.9479 

0.0000 

1.5000 

PAX  PARA  424 

96 

2 

3 

1.0000 

0.9479 

0.0000 

1.5000 

PAX  PARA  430 

96 

2 

3 

1.0000 

0.9896 

0.0000 

2.0000 

PAX  PARA  431 

96 

2 

3 

1.0000 

0.9896 

0.0000 

2.0000 

PAX  PARA  432 

96 

2 

3 

1.0000 

0.9479 

0.0000 

1.5000 

PAX  PARA  433 

96 

2 

3 

1.0000 

0.9479 

0.0000 

1.5000 
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PAX_PARA_434 
PAX_PARA_510 
PAX_PARA_511 
PAX  PARA_512 
PAX  PARA_513 
PAX_PARA_514 
PAX_PARA_520 
PAX_PARA_521 
PAX_PARA_522 
PAX_PARA  523 
PAX_PARA_524 
PAX_PARA_530 
PAX_PARA_531 
PAX_PARA_532 
PAX_PARA_533 
PAX  PARA  534 


96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 
96  2  3 


1.0000 

0.9479 

0.5625 

0.5521 

0.9063 

0.8958 

0.9479 

0.9375 

0.9792 

0.9688 

1.0000 

0.9896 

0.9896 

0.9792 

0.7500 

0.7396 

0.9792 

0.9688 

0.9792 

0.9688 

1.0000 

0.9896 

1.0000 

0.9896 

1.0000 

0.9896 

1.0000 

0.9896 

1.0000 

0.9896 

1.0000 

0.9896 

0.0000  1.5000 
0.0000  11.0000 
0.0000  9.0000 
0.0000  5.0000 
0.0000  4.0000 
0.0000  2.0000 
0.0000  3.0000 
0.0000  7.0000 
0.0000  4.0000 
0.0000  4.0000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 
0.0000  2.0000 
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